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A  TACTICAL  STUDY  OF  EVASIVE  MANEUVERS* 

ULF  GRENANDER** 


ABSTRACT 

In  this  report  some  tactic&I  aspects  of  pursuit  and  evasion  are  studied. 
The  emphasis  is  on  the  analysis  of  the  conceptual  framework  and  on  the 
construction  of  analytic  models.  In  order  that  these  models  be  able  to  de¬ 
scribe  real  pursuit  situations,  an  attempt  is  made  to  incorporate  kinematic 
and  dynamic  restrictions  to  the  extent  that  is  possible  without  making  the 
model  too  difficult  to  handle.  In  particular,  the  relation  between  the  evasive 
tactics  and  the  method  of  prediction  used  by  the  pursuer  is  studied.  In 
order  to  be  as  concrete  as  possible,  a  number  of  special  cam's  are  treated, 
some  of  which  may  be  extended  to  cover  more  general  situations. 
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1  INTRODUCTION 

The  pur|M)iM‘  of  tluH  |>a{MT  Ih  to  dmcuHH  in  quantitAtivo 
terms  some  aH|)eetH  of  evasion  and  jmrsuit.  This  is  one 
of  the  oldest  probleniH  in  the  history  of  military  doc¬ 
trines,  and  much  has  Ix'en  thought  and  written  altout 
it.  Until  VV'orld  War  II,  moat  of  this  waa  expresaed  in 
verbal,  qualitative  ways  and  i-ould  bo  said  to  constitute 
an  important  part  of  the  general  philosophy  of  war.  In 
it^cent  yeara,  after  the  appearance  of  operations  analy¬ 
sis,  one  has  tried  to  formulaUt  the  problems  mathe¬ 
matically  and  to  obtain  numerical  solutiona.  It  go(‘8 
without  saying  that  in  many  or  {lerhapa  most  caa(‘s  this 
approach  is  doomed.  The  reason  for  this  is  clear:  the 
logical  structure  of  the  problem  is  so  complex  and  het¬ 
erogeneous,  that  it  would  Ixi  naive  to  think  that  the 
events  could  be  described  by  mathematicH!  expressions 
without  a  drastic  loss  of  realism.  I>et  us  think,  t\.r  ex¬ 
ample,  of  the  classical  naval  engagement  of  ty|»e  The 
Battle  of  Jutland.  The  outcome  will  dejamd  upon  certain 
factors  that  can  be  discussed  in  probabilistic  Utuib:  the 
effects  of  reconnaissance,  artillery  fire,  torp<-do  attacks, 
and  mine  fields.  One  can  also  include  several  tactical 
parameters:  speed,  armament,  meU*orological  conditions, 
etc.  Thus  we  could,  at  least  in  principle,  measure  and 
analyze  the  basic  properties  of  the  two  war  machines 
and  use  this  to  construct  a  mathematical  model  of  the 
events.  However,  it  would  be  almo.st  im()os8ibIe  to  in¬ 
clude  in  such  a  model  the  long  chal;«  of  human  deci¬ 
sions,  the  breakdown  of  communications,  and  all  the 
mistakes  and  errors  that  can  occur.  Thus  we  would  I>e 
forced  to  leave  out  one  of  the  really  essential  compo¬ 
nents  of  the  battle,  and  this  would  no  doubt  invalidate 
the  analysis. 

On  the  other  hand,  it  may  Ik;  p(j8.sible  to  treat  limited 
problems — perhaps  forming  [mrts  of  a  battle — by  the 
methods  of  operations  analysis.  This  is  so  especially 
when  the  problem  is  well  determined,  with  no  or  few- 
human  decisions  involved  after  the  initial  phase,  and 
when  the  taeikul  fattoro  nan  be  aswimwi  to  be  known. 

In  recent  years  it  has  become  customary  to  apply 
the  methods  of  operations  analysis  to  immense  military 
problems,  involving  major  parts  of  the  straU'gy  of  a 
or  of  otvr  of  it*  amird  forci'c  By  sitnufaiiuti 
techniques  on  electronic  computers  it  is  possible  to 
obtain  solutions  that  may  st‘em  realistic.  In  the  author’s 
opinion  such  overall  solutions  can  lx;  quite  dangerous, 
if  it  is  not  clearly  understood  that  they  only  represent 
one  of  several  means  for  making  decisions:  such  com¬ 
prehensive  decisions  stil!  have  to  Ik;  made  on  jKilitico- 
military  grounds,  taking  into  account  many  factors  that 
are  not  included  in  the  quantitative  analysis. 

In  limited  problems  concerning  tactics  or  the  tech¬ 
nology  of  weai)ons,  the  possibilities  of  a  numerical  ap¬ 
proach  are  greatcT.  With  the  present  development  to- 


wanls  more  t)r  less  automatic  wea{Km  systems  this 
|>osaibility  is  accentuated. 

In  the  following  we  shall  only  deal  with  certain  tac¬ 
tical  situations,  admittedly  of  quiU;  s|K>cial  character, 
but  taken  together  covering  an  interesting  area  of  appli¬ 
cation.  No  attempt  will  Ik;  made  to  formulate  a  general 
quantitative  theory  for  pursuit  and  evasion. 

The  main  goal  will  Ik;  to  |)cnetrate  the  logical  struc¬ 
ture  of  some  typical  problems  concerning  evasive  ma- 
neuvera  and  to  construct  matbematical  mcKlels  appro¬ 
priate  for  a  quantitative  treatment.  It  is  necos.Hary  to 
get  a  good  idea  of  th(>  conceptual  framework,  and  a 
bc’ginning  is  mode  here,  although  it  is  not  at  all  com- 
pleU*.  As  the  reader  will  see,  the  n'sulting  models  vary 
a  gcKxl  deal  among  themselves,  as  could  Ik*  exjK'cted, 
since;  they  are  made  to  fit  radically  different  tactical 
situations.  These  iikkIcIs  are  (K‘rhaps  more  important 
than  the  mathematical  analysis  that  we  attach  to  them. 
The  analysis  should  only  be  inU-rj)reted  as  a  tentative 
solution,  indicating  what  sort  of  mathematical  reasoning 
may  be  useful.  If  one  decides  to  really  use  one  of  these 
mo<lels  or  an  adaptation  of  it,  then  a  much  more  com¬ 
plete  analysis  will  be  needed  anyway. 

The  mathematical  tools  are  mainly  elementary  game 
theory  and  stochastic  processes.  We  shall  use  only  the 
basic  notions  of  game  theory,  and  the  applications 
will  be  simple  and  direct.  For  the  reader’s  convenience 
some  notes  are  attached  at  the  end  of  the  pa{K*r,  and 
it  should  be  consulted  for  more  information  about  the 
mathematical  techniques  us(‘<l,  as  well  as  for  biblio¬ 
graphical  information. 

The  study  of  evasive  maneuvers  mu.st  1k‘  one  of  the 
many  objects  of  work  for  the  groups  of  mathematicians 
involved  in  ojKrations  analysis.  As  far  as  the  author 
has  lK;en  able  to  find  out,  little  has  lK“cn  published  on 
the  subject,  jxrhaps  for  reasons  of  secrecy.  Therefore 
it  is  not  j)08sible  to  give  a  full  historical  presentation 
of  the  development  of  the  subject.  It  would  not  be 
surprising  i(  some  of  the  b;ib;wing  is  krmwn  ^)Teviously, 
although  it  has  not  been  made  publicly  known. 

The  first  di.scussion  of  the  problem  in  mathematical 
terms  seems  to  be  due  to  Steinhaus  (1900),  who  already 
in  llhW  (urtnuiaiod  the  (ulliiw'ing  problem  Two  players 
E  and  P,  play  a  game:  P  pursues  E,  who  tries  to 
avoid  being  caught.  Denote  by  Tp  and  Tg  the  tactics 
used  by  P  and  E.  respectively,  and  by  t(Tp,  Tg)  the 
time  it  takes  for  P  to  catch  E.  Steinhaus  then  suggests 
that  it  is  reasonable  to  choose  Tp  and  Tg  such  that 

t(Tp,  Tg)  =  min  max  t{Tp,  Tg). 

Tp  Tg 

The  reader  familiar  with  game  theory  will  notice  imme¬ 
diately  that  this  is  close  to  the  concept  of  optimal 
strategy.  Actually,  Steinhaus  seems  to  have  been  aware 
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of  the  baitic  problvin  of  whether  min  max  t  alwayn  equaU 
tnaxminf.  No  detail(Hl  diMcuaHion  in  ({iven  in  the  pa|M‘r 
referrwl  to. 

The  aarne  problem  ha>  bt»en  treated  rewntly  by 
ICclendioridzc  (lOfll).  He  auumoa  that  P  and  K  move 
in  the  n  dimenaional  apace  IP,  and  their  inotionH  are 
doacrilx'd  by  the  equalionu 


dx 

^  dt 


du 

^  y^dt 

Hero  X  and  y  are  vectora  describing  the  poaitiona  of  P 
and  E,  reapectively.  The  parameters  u^R'  and  vkR‘ 
represent  their  tactical  behavior,  or,  more  precisely,  the 
tactics  are  given  as  functions  u u(0  andt’‘*t(().  As¬ 
suming  certain  regularity  conditions  and  that  u  can 
take  values  in  a  closed  convex  polyhedron  Q'  <=  R', 
Kelendieridze  tries  to  find  the  tactics  realizing  the  ex¬ 
tremal  value  max,  min,  <(u,  v),  where  t{u,  v)  stands  for 
the  time  it  takes  for  P  to  establish  contact  with  E. 
Such  a  solution  of  the  extremal  problem  could  be  called 
an  optimal  pursuit  tactic.  He  solves  this  problem  for 
the  case  that 

i  =  f(z,u)  --‘  Ax+  Bu, 

where  A  and  B  are  constant  n  x  n  and  n  x  r  matrices, 
respectively.  His  main  result  is  the  following.  If  «(<), 
e(()  represent  such  an  optimal  tactic,  and  if  x{l)  and 
y{t)  are  the  corresponding  trajectories  leading  to  the 
pursuit  time  T,  then  there  are  vector  valued  functions, 

v(0  =  (viiO.  ■■■>  Vn(0]  1 

z(0  =  (;f,(0,  Xtit) . 1 


such  that 


JJi 

It  ^t  p,  > 

dip, 


Qt^Vt' 


Here,  //  is  the  Hamiltonian 


and  for  all  t  in  the  interval  (0,  T)  we  have 
H[ip{t),  x(t),  u{t),  X(t),  y(t),  v(<)]  •=  max  min  H[ip,  x,u,X,  y,  v]. 

U  V 

Further,  the  above  value  of  H  is  constant  throughout 
the  time  interval,  and  i{iT)=  -  X(T). 


One  should  also  mention  a  result  of  Zi^ba  (1900). 
He  considers  motion  in  a  plane  where  the  pursuer  is 
at  the  point  (Xp,  y^)  and  his  op()onent  at  the  point 
(z,,y,).  Given  two  homogeneous  functions  fp(Xp,  yp,  ip,  Vp) 
and  i',(x,,  y,,x,,  y,)  describing  the  absolute  values  of 
the  velocities  allowed,  w’o  want  to  find  functions 
fpfWp.a:,.  y,)  and  V’p  '  Vp(^p- Vp- V*)- 


\  ip\-v\. 


Similarly,  for  the  evader  we  want  to  find  similar  func¬ 
tions  (p,  and  ipf,  such  that 


'pi '  ip\  =•  «i 


The  equations  of  motion  arc  then 


^p=fp> 

yp  v'p- 
i,  <p,< 
y.  vv- 


with  some  initial  condition.  As  payoff  function  we  use 
the  time  it  takes  until  capture  happens;  this  time  may 
be  infinite.  If  the  game  is  definite  and  under  certain 
regularity  conditions,  Zi^ba  states  a  rule  how  to  arrive 
at  a  first  order  partial  differential  equation  for  the  time 
of  capture,  and  this  gives  us  the  optimal  tactics. 

Without  going  into  details  it  is  obvious  that  these 
results  have  a  good  deal  in  common  in  their  approach 
to  the  problem.  They  as^-ume  the  motions  of  the  pur¬ 
suer  and  th"  evader  to  be  fairly  general,  subject  to 
certain  restrictions  upon  the  velocities.  These  restric¬ 
tions  can  be  space  dependent,  and  actually  that  seems 
to  be  the  case  when  these  methods  are  of  real  interest. 
The  same  is  true  in  the  works  of  Isaacs  (1954  a,  b), 
although  hia  set  up  is  different. 

Using  these  results  we  can  certainly  deal  successfully 
with  some  pursuit  problems,  at  least  in  principle. 

To  actually  compute  the  solutions  will  be  laborious, 
at  least  if  we  try  to  deal  with  the  very  complicated 
kinematic  restrictions  and  the  lack  of  compleU>  informa¬ 
tion  that  sometimes  obtain. 

It  is  natural  to  ask  if  wo  could  arrive  at  usidul  solu¬ 
tions  by  restricting  alreatly  from  the  beginning  the  be¬ 
haviors  of  the  pursuer  and  his  opjwnent.  We  could 
assume  that  their  motions  be  described  in  probabilistic 
terms  and  specify  a  priori  what  tjqw  of  stochastic  be¬ 
havior  we  can  allow,  taking  into  account  what  we  know 
beforehand  about  the  capabilities  of  the  two  opponents. 
Naturally,  we  could  not  expect  our  solution  to  be  quite 
optimal.  On  the  other  hand,  we  could  hope  to  achieve 
a  higher  degree  of  realism,  at  least  in  those  cases  where 
the  models  can  be  made  sufficiently  detailiKi. 
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An  early  attempt  in  thin  directiun  can  be  found  in 
a  paper  by  Yovita  k  Jacluon  (1955).  Although  their 
paper  is  not  written  in  the  terminology  of  purauit  prob¬ 
lems,  it  is  obvious  that  it  can  lx;  interpreted  in  such 
a  way.  Consider  a  stationary  stochastic  process  x{t), 
hidden  by  noise  n(f),  so  what  we  can  observe  is  only 
their  sum  y{t)’=-  x{t)  +  n(t).  By  filtering  the  y(f)  process, 
we  try  to  restore  x(t)  as  well  as  possible  in  the  sense 
of  the  least  squares  criterion.  If  the  spectra  of  x(t)  and 
n(<)  are  known,  then  we  can  do  this  by  the  standard 
linear  theory  of  stationary  processes.  On  the  other  hand, 
we  may  view  this  as  a  game  between  two  players,  one 
of  which  controls  the  spectrum  of  the  x-process  and 
tries  to  prevent  successful  filtering.  The  other  player 
tries  to  counteract  this  by  choosing  a  s::itable  filter.  We 
have  a  max  min  problem  at  hand.  Yoviti  k  Jackson 
solve  this  problem  for  the  case  where  the  mean  square 
value  of  an  nth  order  derivative  d''x(t)/dt’'  has  been 
fixed  in  advance.  We  shall  see  later  in  the  text  how 
this  corresponds  to  pursuit  problems  of  considerable  in¬ 
terest. 

Such  max  min  problems  arise  in  many  pursuit  prob¬ 
lems.  If  possible,  one  would  like  to  have  the  solution 
to  the  corresponding  game;  especially  one  should  in¬ 
vestigate  if  the  game  is  definite.  Grenander  (1960)  has 
studied  the  following  problem.  One  player  controls  the 
spectrum  of  the  stationary  stochastic  process  x{t),  with, 
say,  a  side  condition  on  the  total  spectral  energy.  We 
could  think  of  x(t)  as  an  acceleration.  The  quantity 
that  we  are  really  interested  in  is  of  the  form 

2=  J  a{t)x(t)dt, 

where  a{t)  is  a  given  function;  z  may  measure  the  loca¬ 
tion  of  the  evader.  The  other  player  observes  the  past 
trajectory  or  x{t),  He  tries  to  use  this  observa¬ 

tion  to  predict  z  by  some  z*  and  has  at  his  disposal 
all  possible  linear  predictors.  Using  as  a  payoff  func¬ 
tion  the  mean  square  error  E[2  -  z*]*,  it  is  shown  that 
the  game  is  definite.  Further,  the  value  of  the  game 
is  simply  the  largest  eigenvalue  of  the  integral  kernel 

1- V) 

K(x,y)=-  a{x  +  w)  n{y+  u)  du. 

Jo 

The  optimal  forms  of  z(0  and  of  the  predictor  can  be 
expressed  directly  through  the  nxneepundiiig  i-igi'nluiir- 
tion. 

This  must  be  an  important  part  of  a  theory  of  pur¬ 
suit  and  evasion.  However,  we  shall  not  start  directly 
with  these  somewhat  complicated  problems.  Instead  we 
shall  first  consider  some  simpler  problems  and  use  these 
a»  OUT  startiiig  point. 

4 


2.  DESCRIPTION  OF  THE  PROBLEM— BASIC 
NOTIONS 

2.1.  Questions  of  Dimensionality 

Let  us  denote  the  «.va(Ier  by  E,  or,  if  we  have  several 
evaders,  by  i?,,  E„  ....  At  a  certain  time  point  t, 
let  us  denote  by  Ef  the  position  of  E  expressed  in  a 
suitable  coordinate  system.  The  dimensionality  dg  of  the 
space  in  which  E  moves  is  not  always  well  determined 
by  the  physical  background  ot  the  problem.  Often  it 
depends  upon  what  the  really  important  aspects  of  the 
problem  are.  Take,  e.g.,  a  tank  using  evasive  maneuvers 
in  order  to  avoid  being  hit  by  antitank  rockets.  Because 
of  its  low  angular  velocity,  its  normal  acceleration  is 
practically  negligible.  Unless  the  time  of  flight  of  the 
rocket  is  unusually  long,  it  may  be  convenient  to  de¬ 
scribe  the  position  of  the  tank  by  a  single  coordinate, 
df  =  1 .  (This  question  also  depends  upon  the  ballistic 
properties  of  the  rocket,  whether  it  is  guided,  an  so  on.) 
If  the  weapon  used  has  a  long  time  of  flight  we  will 
have  to  work  in  two  dimensions,  d,=  2. 

The  case  dg  =  I  is  mainly  of  theoreti'’'\l  interest,  since 
in  most  military  situations  the  evader  has  more  degrees 
of  freedom  at  his  disposal.  It  seems  that  the  most  im¬ 
portant  case  would  be  dg=2.  We  meet  this  situation, 
of  course,  when  the  motion  of  E  is  bound  to  the  sur¬ 
face  of  the  land  or  of  the  sea.  But  even  when  the 
problem  may  appear  as  three-dimensional,  it  can  be 
convenient  and  realistic  to  assume  that  dg  =  2.  The 
evader  E,  say  an  airplane  or  missile,  may  be  free  to 
move  in  three  dimensions,  but  circumstances  may  re¬ 
strict  it  to  motion  in  the  plane,  in  order  that  the  navi¬ 
gation  system,  the  bomb  sight,  or  the  weapon  be  able 
to  function.  More  about  this  later. 

It  is  not  necessary  to  say  much  about  ds=3;  it  is 
obvious  that  three-dimensional  pursuit  problems  e bound. 
But  how  about  ds>3,  does  this  case  have  any  prac¬ 
tical  relevance?  When  the  target  E  has  a  considerable 
extent  in  space,  not  negligible  compared  to  the  ballistic 
dispersion  or  to  the  accuracy  of  the  reconnaissance,  then 
one  must  take  into  account  the  geometric  configuration 
of  the  target.  This  gives  us  (at  most)  three  more  de¬ 
grees  of  freedom,  e.g.  the  Eulerian  angles  of  a  solid 
body.  As  a  typical  illustration  we  may  men  ton  an  air¬ 
plane  pursued  by  a  missile  with  an  infrared  homing 
device.  The  probabiility  ol  the  missile  hitting  the  target 
will  depend  upon  the  angle  between  the  hot  exhaust 
of  the  jet  and  the  line  plAar-miBsilr 

What  has  been  said  here  about  E  and  dg  is  applicable 
in  part  also  to  P  and  dp. 

In  the  author’s  opinion  the  general  E  -  P  problem 
to  be  discussed  hero  contains  the  fundamental  diffi¬ 
culties  already  in  its  two-dimensional  form.  When  the 
tnrmbeT  id  dimiyiisiuiTs  Tircreases,  we  uaii  expect  a  sitoilaT 
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iiientaHc  in  the  CDinputational  (and  poHnihly  analytical) 
difficulties  that  makes  it  hard  to  work  out  a  eompre- 
hensive  solution.  Difficulties  of  iin  essentially  now  char¬ 
acter  do  not  seem  to  enter. 

2.2.  Bestrictions 

When  considering  as  a  function  of  time  there  are 
always  strong  restrictions  upon  its  l)ehavior.  It  is  of 
the  utmost  importance  that  wo  do  not  lose  these  kine¬ 
matic  restrictions  when  we  decide  upon  a  suitable  mathe¬ 
matical  model.  Instead  we  must  make  them  precise  and 
express  them  in  quantitative  form.  Sometimes,  this  re¬ 
striction  simply  means  that  must  be  in  a  given 
region  S,  which  may  depend  upon  time,  More 

often  the  restriction  is  expressed  in  terms  of  the  velocity 
vector  Et  or  of  t.He  velocity  |.^,|,  perhaps  \Ex\<v.  Here 
V  may  be  given  by  physical  reasons  (maximunt  speed 
of  an  airplane)  or  from  tacticr,!  considerations  (maxi¬ 
mum  quiet  speed  of  a  submarine).  Similarly,  we  may 
require  that  the  acceleration  be  bounded,  \Ex\''a,  or 
that  some  angular  velocity  be  bounded,  |^,|  ^99.  In  this 
connection  we  may  think  of  the  load  factor  of  an  air¬ 
plane. 

Clonditions  of  this  type  can  sometimes  be  replaced  by 
restrictions  upon  the  corresponding  average  values;  this 
may  be  more  realistic  and  deserves  a  brief  discussion 
here.  In  a  certain  situation  we  may  be  willing  to  admit 
the  possibility  that  some  quantity,  say  an  acceleration, 
\Et\,  niay  take  large  values,  but  under  short  periods 
only,  (t  is  then  convenient  to  express  the  restriction 
in  integral  form.  Let  the  admissible  functions  Ef  form 
an  ensemble  £  (the  set  of  strategies  for  E).  If  we  have 
a  probability  m'^asure  P  on  £  (a  mixed  strategy),  then 
we  know  that  under  certain  conditions  there  is  a  close 
relationship  between  temporal  average  values  and  ensemble 
mean  values  over  £.  We  may  then  use  conditions  of  the 
form 

just  to  mention  a  few  possibilities.  It  is  clear  that  a 
wel’ -chosen  formulation  of  this  sort  of  restriction  must 
be  a  compromise  between  realism  and  analytic  tracta- 
bility. 

2.3.  Information  and  Uncertainty 

The  positions  E^  and  P,  of  the  evader  and  pursuer, 
respectively,  are  functions  with  certain  properties,  they 
are  elements  of  specified  function  spaces.  However,  it 
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w(  uid  not  always  be  correct  fo  assume  that  the  two 
opjx)nentH  know  their  own  |S)Nition  (post  or  prt^sent), 
and  still  less  their  op|)onent's  |>osition.  Actually,  thin 
will  de|.<‘nd  very  much  ujK)n  what  n/ivigation  syst-  1  in 
used  and  upon  the  method  of  localizing  the  oppon  .t. 
Here,  all  possibilities  exist  on  a  scale  between  complete 
information  and  complete  lack  of  information.  It  may 
happen  that  one  has  reasonably  good  information  in 
l)oth  directions  (say,  in  an  artillery  duel  between  two 
destroyers),  that  one  has  only  little  information  in  one 
or  both  directions  (say,  for  a  fregatc  hunting  a  sub¬ 
marine),  or  that  information  is  completely  missing  in 
one  direction  (small  scale  landing  operation,  without 
radar  reconnaissance,  attacked  by  guided  missiles).  The 
uncertainty  may  here  be  expressed  is  statistical  terms: 
the  hypothetical  position  is  a  stochasti.-  variable  with 
some  probability  distribution  around  the  true  position. 
It  is  important  to  note  the  difference  between  the  case 
where  this  distribution  is  more  or  less  constant,  and 
that  where  it  depends  strongly  upon  time.  The  latter 
case  can  be  exemplified  by  a  navigation  system  based 
on  dead  reckoning,  say,  ba.H(‘(;  on  inertial  navigation, 
and  assuming  that  no  new  fix  is  obtained  during  the 
time  interval  under  consideration.  The  cumulative  effect 
of  initial  errors  of  observation  can  have  important  con¬ 
sequences  when  studying  optimal  taetics.  It  is  also  im¬ 
portant  sometimes  to  note  that  one  side  may  have  some 
information  about  the  form  and  location  of  the  trajec¬ 
tories  of  a  missile  but  not  about  the  time  of  firing. 

2.4.  Purpose  of  Evader  and  Pursuer 

To  study  the.se  tactical  problems  by  operations  analy¬ 
sis  we  must  first  of  all  decide  what  E  and  P  seek  to 
obtain.  A  simple  assumption  (usually  too  oimplc)  would 
be  to  say  that  P  wishes  to  reach  E  as  soon  as  possible, 
while  E  wishes  to  postpone  the  encounter  as  long  as 
possible.  Often  it  is  more  realistic  to  assume  that  E 
has  a  concrete  aim,  say,  to  reach  a  given  point,  line 
or  area,  or  that  he  wants  to  keep  a  certain  average 
course  (zigzagging  to  avoid  contact  with  P).  Perhaps  E 
wishes  to  reach  a  certain  point  as  quickly  as  possible, 
taking  into  account  that  the  evasive  maneuvers  take 
time  but  have  to  be  made  in  order  to  make  the  risk 
small  that  P  get  an  opportunity  to  use  his  weapon 
system.  A  quite  different  aim  is  when  E  tries  to  ma¬ 
neuver  in  an  unsystematic  manner  in  order  that  P  lose 
contact  with  him,  so  that  he  can  get  away'  unobserved 
(a  hunted  submarine).  But  even  here  we  may  get  a  side 
condition:  these  evasive  maneuvers  must  be  made  such, 
that  the  effect  of  the  weapon  sysb'm  of  the  enemy  can 
lie  expected  to  be  small. 

It  is  not  necessary  that  P’s  aim  is  to  use  his  weapons 
at  all,  instead  he  may  try  to  collect  information  about  E. 
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Hunting  Hubmarinoa  with  helicopter  ia  a  typical  caau,  the 
helicopter  makea  the  obaervations  aa  followa;  it  atopa, 
lowers  an  active  hydrophone  into  the  aea  and  liatena 
for  the  aubmarine  in  different  directiona.  If  the  sub¬ 
marine  has  been  located  but  trios  to  get  away,  the  heli¬ 
copter  (P)  must  try  to  predict  its  future  position,  go 
there,  and  start  lisU-ning  again. 

2.6.  Prediction 

When  working  on  specific  pursuit  problema  one  be¬ 
comes  soon  aware  of  the  following  logical  relationship 
that  is  basic  for  the  whole  complex  of  problema.  When 
E  attempts  evasive  maneuvers,  this  will  influence  the 
tactical  behavior  of  P:  P  will  use  a  method  of  predic¬ 
tion  in  order  to  counteract  the  evasive  maneuvers.  In  con¬ 
nection  with  mathematical  prediction  problems  one  usu¬ 
ally  thinks  of  the  Kolmogorov-Wiener  theory  for  optimal 
prediotors.  This  theory  has  shown  itself  very  useful  in 
the  design  of  fire  control  systems.  It  is  of  relevance 
in  the  present  context  too,  but  unfortunately  it  is  too 
restrictod  for  immediate  application  in  many  cases,  as 
will  be  shown  later  on. 

It  is  practical  to  fix  some  terminology.  By  the  order 
of  a  predictor  we  shall  mean  the  number  of  derivati^’es 
of  the  function  E,  at  <-°(g  that  are  used  to  predict 
the  value  of  Et+s,  h>0.  This  notion,  of  course,  applies 
only  to  a  predictor  that  uses  only  the  instantaneous 
values  of  E,  and  of  some  of  its  derivatives.  A  first 
order  predictor  is  then  of  the  form  E*.,h  =  f(Et,  ^t)-  ®y 
a  linear  predictor  we  shall  mean  a  predictor  constructed 
as  a  linear  combination  of  the  past  and  present  values 
of  Ef,  or,  more  precisely,  as  a  limit  of  such  linear  com¬ 
binations.  This  distinction  is  not  always  made  clear  in 
the  literature.  The  classical  prediction  theory  treats  linear 
predictors  only,  and  this  can  be  a  severe  restriction. 

2.6.  Optimality  Criterion 

We  have  already  discussed  the  objectives  of  the  pur¬ 
suer  and  the  evader.  This  discussion  was  in  general 
terms  and  perhaps  too  vague.  For  a  quantitative  treat¬ 
ment  it  is  necessary  to  define  precisely  an  optimality 
criterion.  This  can  be  the  probability  of  (at  least  one) 
hit,  the  expected  number  of  hits,  the  probability  that  E 
can  reach  a  certain  region  unharmed  or  that  he  avoids 
being  detected.  It  could  also  be  quantities  such  as,  the 
time  till  P|=  Ef,  or  till  |P, -iS,|  <r.  Perhaps  one  should 
use  the  length  of  the  trajectory  instead  of  the  time 
spent  in  it.  It  is  w-ell  known  by  the  practising  opera¬ 
tions  analyst  that  the  choice  of  optimality  criterion  is 
decisive  for  the  outcome  of  the  analysis,  and  that  it 
is  seldom  or  never  possible  to  poiiit  out  a  uniquely 
determined  criterion  as  superior  to  the  other  available 


criteria.  If  wo  aim  at.  some  realism  in  our  study,  we 
must  therefore  be  prepared  to  work  with  several  cri¬ 
teria  simuItancouNly,  even  though  this  wiJi  make  the 
theory  more  heterogeneous. 

2.7.  Different  Types  of  Solution 

When  wo  have  fixed  the  tactical  situation  and  the 
optimality  critf^rion,  we  can  try  to  work  out  a  solu¬ 
tion  on  three  different  aspiration  levels. 

(1)  We  may  assume  that  one  of  the  opponents  has 
chosen  this  tactics  in  some  way,  and  that  this  is  known, 
at  least  partially,  to  the  other  one.  This  assumption 
could  bv''  jit'tified  when  the  tactical  behavior  depends 
directly  upon  the  technical  equipment  that  one  believes 
will  be  used  during  the  relevant  period.  Then  we  have, 
mathematically,  an  ordinary  problem  of  variation,  and 
we  should  study  existence  and  uniqueness  of  solutions 
to  an  extremal  problem,  max,/(z,  yg).  Above  all,  we  must 
seek  a  suitable  way  to  compute  the  solution,  analyt¬ 
ically  or  numerically,  in  order  to  obtain  a  real  solution. 

(2)  On  the  other  hand,  we  may  not  bo  able  to  assume 
a  priori  that  the  tactics  of  the  opponent  is  known.  In 
such  a  case  wo  have  a  double  extremal  problem  of  the 
type  maXj  min„/(z,y).  Often  the  tactics  can  be  described 
by  one  or  several  functions,  so  that  z  and  y  will  take 
values  in  some  function  space.  It  is  not  always  true 
that  there  exists  an  optimal  tactics.  This  way  of  looking 
at  the  problem  may  be  considered  as  one  half  of  a 
game:  we  look  at  it  only  from  the  point  of  view  of  one 
player  and  try  to  maximize  his  payoff,  assuming  that 
his  opponent  behaves  in  an  optimal  manner. 

(3)  Finally  we  may  try  to  solve  the  whole  game :  de¬ 
termine  min^  max,  /(z,  y),  and  see  if  this  value  coincides 
with  the  value  we  already  got.  In  such  a  case  the  game 
is  definite,  and  mathematically  the  situation  is  favor¬ 
able.  In  general,  the  spaces  of  admissible  strategies 
(usually  randomized)  will  be  so  large  that  we  cannot 
hope  to  meet  definite  games  very  often.  It  seems  that 
the  existing  theory  of  games  will  give  few  concrete  hints 
in  this  direction,  and  it  will  therefore  be  necessary  to 
study  in  detail  the  specific  situations. 

Normally  we  would  prefer  to  work  on  the  highes*^ 
level.  However,  in  order  to  arrive  at  definite,  and  me  the- 
matically  tractable,  games,  we  would  often  have  to  im¬ 
pose  strong  restrictions  and  simplifi''ationB.  This  will  be 
evident  in  the  following  chapters.  Therefore,  we  are  con¬ 
fronted  by  a  choice:  do  we  want  a  mathematically 
attractive  and  polished  solution  to  a  problem  with  little 
relation  to  reality,  or  do  we  prefer  a  less  complete  solu¬ 
tion  of  a  problem  formulated  in  a  more  realistic  way? 
Many  operations  analysts  (including  the  author)  believe 
that  the  second  alternative  is  often  preferable  to  the 
first  one. 
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3.  THE  DISCRETE  APPIIOACH 
3.1.  Oeneral  Conaidtraliona 

Let  U8  specialize  and  make  the  situation  more  con¬ 
crete.  A  pursuer  P  and  an  evader  E  move  in  a  plane, 
2,  with  certain  kinematic  restrictiohs,  at  least  as  far 
as  E  is  concerned.  The  sneeds  of  P  and  E  will  be  de¬ 
noted  by  V  and  v,  respectively.  To  start  with,  it  will 
bo  assumed  that  P  can  move  more  freely  than  E,  and 
that  the  spud  ratio  P/v  >  1 .  We  may  think  of  .E  as  a 
submarine  carrying  out  evasive  maneuvers  submerged, 
but  that  its  vertical  motion  can  be  neglected,  so  that 
its  position  is  described  by  plane  coordinates.  P  may 
be  a  helicopter  trpng  to  find  and  follow  E.  Or  P  may 
be  one  (probably  one  out  of  several)  antisubmarine 
rocket  fired  from  a  submarine  chaser. 

Let  us  assume  that,  at  a  certain  moment,  t  ---  0,  E  and 
P  observe  each  other,  and  that  P  has  complete  in¬ 
formation  about  the  position  and  the  velocity  vector 
of  E.  (Later  on  we  will  have  to  relax  this  unrealistic 
condition.)  It  is  irrelevant  whether  E  has  or  does  not 
have  information  about  P’s  position  and  velocity  vector, 
since  P’s  continued  motion  is  very  free  and  hence  not 
strongly  dependent  upon  initial  values. 

After  t  =  0,  the  oppont  nts  cannot  observe  each  other 
for  a  while,  and  we  are  waiting  for  what  will  happen 
at  some  future  time  t  =  h.  In  the  examples  mentioned 
above,  this  may  correspond  to  the  time  point  when  the 
helicopter  lowers  its  hydrophone  again  or  when  the  anti¬ 
submarine  rocket  reaches  the  plane  where  the  target 
moves.  During  the  interval  (0,  h)  E  has  moved  along 
some  trajectory  with  the  end  point  E^  =  Q  that  can  be 
situated  in  a  rc'jion  S  of  the  plane,  see  Fig.  1. 


Fig.  1.  The  region  S  which  the  evader  E  can  reach. 

The  boundary  to  the  right  of  S  corresponds  to  E  using 
his  maximum  speed.  The  lower  and  upper  boundaries 
of  S  correspond  to  maximum  angular  velocity.  It  is 
often  reasonable  to  assume  that  E  uses  his  highest  speed 
all  the  time.  If  this  is  so,  then  S  will  look  something 
like  Fig.  2.  The  region  will  be  long  and  narrow,  unless 
E  can  steer  so  much  that  the  region  is  made  wider. 

Now  we  must  define  the  tasks  of  P  and  E  and  the 
corresponding  optimality  criterion.  If  P  tries  to  fire  at 


Fig.  2.  The  region  which  E  can  reach  with  maximum  speed. 

E  to  hit  and  destroy  him,  then  w'e  may  use  the  proba¬ 
bility  of  hit  a  criterion.  Let  us  suppose  that  this 
probability  is  a  decreasing  function  f{R)  of  the  distance 
P=|Pft  — Pft|.  E  will  try  to  make  P  large  by  choosing 
among  the  possible  values  of  E^.  P  will  do  the  op¬ 
posite. 

Let  us  first  study  the  case  where  P  choosej  a  posi¬ 
tion  P^£S.  Then  wo  can  describe  his  tactics  by  a  proba¬ 
bility  distribution  Fp  over  S.  Similarly,  E  has  some 
probability  distribution  Fg  over  S.  If  we,  for  simplicity, 
choose  the  criterion  as  —  R*,  it  is  clear  that  E  wishes 
to  maximize  U,  and  P  wishes  to  minimize  U,  where 

C/=f  f  R*(P„E,)dFg,dFp,. 

jEklS  J  Pk*S 

The  payoff  function  R^  is  a  continuous  function  of  P* 
and  Eg. 

S  is  usually  a  compact  pr.rt  of  the  plane.  A  general 
result  oi  the  classical  game  theory  tells  us  that  the 
game  is  definite,  it  has  a  value.  It  remains  to  deter¬ 
mine  the  corresponding  tactics.  In  general  we  will  do 
this  numerically,  but,  if  the  situation  is  simple  enough, 
anal5dical  methods  may  succeed.  To  familiarize  our¬ 
selves  with  the  problem  wo  shall  in  the  next  section 
consider  a  few  simple  cases.  We  will  not  meet  anything 
mathematically  exciting,  nor  will  the  models  be  of  much 
practical  value.  Nonetheless,  we  hope  to  understand  the 
pursuit  problem  better  in  this  way,  enabling  us  to  go 
on  to  more  interesting  situations. 

3.2.  A  One-dimeminiutl  Example. 

Let  us  assume  that  S  consists  of  an  arc  of  a  circle, 
say,  an  arc  smaller  than  a  half-circle,  see  Fig.  3.  One 
can  guess  the  solution:  P  shall  go  straight  ahead,  and 
E  shall  go  to  one  of  the  end  points  of  S,  with  the 
probabilities  J,  i.  To  prove  this,  we  note  that  if  P  goes 
to  Pg,  and  if  E  uses  the  tactics  described,  then  the 
payoff  is 

This  inequality  holds,  since 
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Fig.  3.  The  cimo  where  S  consista  of  an  arc  of  a  circle, 
li-*’  I  *’  I  i  *■  2 I  I  2*’ 

■=2(-2-*)’+2e‘>2("7)‘+2»L.  2e. 

On  the  other  hand,  if  P  goes  straight  ahead,  and  if  E 
goes  to  some  point  E^,  the  payoff  is  at  must  fo-  Hence 
the  two  tactics  described  above  are  optimal,  and  the 
value  of  the  game  is  Zq. 

We  leave  to  the  reader  to  study  the  case  of  S  being 
a  circular  arc  with  an  opening  angle  of  more  than  180°. 

There  does  not  seem  to  be  any  good  reason  why  Pf^ 
should  only  be  allowed  to  take  values  in  S.  However, 
with  the  (somewhat  arbitrarily  chosen)  payoff  function 
that  we  have  used,  R*{P^,E^),  the  pursuer  P  will  not 
lose  anything  by  restricting  himself  to  the  region  3 
formed  as  the  convex  hull  of  S. 


B 


Fig.  6.  The  esae  where  S  coniiata  of  a  circular  aector. 


3.3.  A  More  Realiatic  Example 

The  situation  described  can  be  said  to  correspond  to 
the  case  when  the  evader  uses  his  highest  speed  all  the 
time.  A  somewhat  more  realistic  assumption  would  bo 
to  let  S  consist  of  a  narrow  region,  resembling  a  thin 
crescent.  We  do  not  expect  that  this  will  lead  to  any 
drastically  changed  tactics.  That  may  be  the  case,  how¬ 
ever,  when  E  sometimes  slows  down  very  much,  so  that 
S  will  have  a  form  similar  to  a  sector.  For  simplicitj’, 
let  S  be  such  a  sector,  see  Fig.  5.  To  treat  this  case, 
we  note  that  the  payoff  function  is  convex  in  the  vari¬ 
able  P: 

lie-  x/>,  -  (1  -  X)  />, II*  exile  -  i>,||* + (1  -  X)  lie  -  p.||*, 

see  Fig.  6. 

We  have  R*  ^  r*  +  - 'Zxgr  cos  <p 

Ji  p2 

...d  -^-2e->o. 

We  know  then  (Fundamental  theory  for  continuous 
game.s,  see  Notes)  that  the  best  strategy  for  P  is  pure, 
that  the  value  of  the  game  is 
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Fig.  4.  The  case  where  S  consists  of  a  segment  of  a  circle. 


V  =  min  max  R*(E,  P), 

P  E 

and  that  the  optimal  strategy  Pg  pursuer  is  a 

solution  of  the  equation 

max  R*(E,  Pg)  =  v. 
s 


Let  us  see  how  this  would  modify  the  discussion  of 
our  example.  The  region  S  is  now  a  segment  of  the 
circle,  see  Fig.  4.  The  best  tactics  for  E  will  be  the 
same  as  before,  whereas  P  should  not  steer  to  the  mid¬ 
point  of  the  chord  bounding  S.  With  notation  used  in 
Fig.  4,  we  have 

Zi  =  {d-y)*  +  x*,  I 
Z|=  (d  +  y)*  +  z*,  I 

BO  that  JZ*  +  J/2  =  d*  +  y*  +  z*  >d*. 

This  is  one  of  the  inequalities  needed  to  prove  the 
statement.  The  other  follows  immediately. 


To  compute  the  value  v  we  must  first  maximize 
R*(E,  P)  when  E  varies  and  P  is  kept  fixed.  The  maxi¬ 
mum  is  attained  when  E  is  in  one  of  the  corners  of 
the  triangle  ABC  (Fig.  6).  Then  we  minimize  when  P 
varies,  and  the  minimum  is  realized  when  P  is  chosen 
as  the  center  of  the  circle  circumscribing  ABC\  this 
can  be  seen  using  a  differential  argument.  It  remains 
to  determine  the  best  strategy  for  E :  it  will  be  to  go 
to  one  of  the  corners  A,  B,  or  C,  with  the  probabilities 

Pr{B)~Pr{C)  =  p-~i 
4  cos 

Pr(A)=-l-2p, 


v/2’ 


V< 


n 
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Pig.  0.  Demonstration  that  the  payoff  function  is  convex. 


Fig.  7.  The  case  where  iS  is  a  circular  cone. 


choose  instead 

Pr(Ii)  Pr{P)  A,  I 
Pr(A)  0,  j 

and  should  be  taken  as  the  midpoint  of  the  line 
segment  AB. 

The  latter  case  is  proved  in  the  same  way  as  in  3.2. 
In  order  to  prove  the  first  case,  we  study  the  function 

/(P)=  (1  -2p)  r\  +  pri  +  pr|. 

Denoting  r,  by  x,  we  find 

/(P)  =  ( 1  -  2p)  X*  +  p[x*  +  g*  -  2xq  cos  f] 

+  p[x*  +  p*  —  2xq  cos  (y)  -  9?)] 

=  2pQ*  +  X*  -  2pxQ  [cos  (p  +  cos  (v)  -  gs)]. 


3.4.  A  Three-dimensional  Example 

It  is  clear  that  we  ean  treat  in  a  similar  way  situa¬ 
tions  where  S  has  a  more  complicated  form.  In  prin¬ 
ciple  we  ean  also  deal  with  three-dimensional  versions 
of  the  same  problem.  It  may  Ik;  instructive  to  consider 
the  ca.se  of  S  being  a  circular  cone  with  the  opening 
angle  tp  and  the  side  q  (Fig.  7).  P’s  best  strategy 
is  to  steer  toward  the  center  of  the  sphere  circum¬ 
scribing  the  cone.  E  shall  go  to  the  vertex  of  the  cone 
v/ith  the  probability  1  -  p,  and  to  the  periphery  of  the 
circle  bounding  the  base  of  the  cone  with  probability  p. 
On  that  periphery,  E  can  choose  any  probability  distri¬ 
bution  the  mean  of  which  coincides  with  the  center  of 
the  base.  The  probability  p  is  given  as 

1 _ 

^  2cos*y)/2 


Considered  as  a  function  of  x  and  p,  /(P)  will  take  its 
minimum  inside  S  in  the  point 


T 


V 

2’ 


X  =■■  2pQ  cos 


This  minimum  is  now  computed  as 


min  /(P)  =  2pp*  -  4p*p*  cos* 

p  2 


The  evader  can  maximize  this  expression  by  choosing 
for  p  the  value  given  above,  giving 


x  = 


Q  , 

2  cos  y)/2’ 


max  min  /(P)  =  x*  = 

X  p 


4  cos*  y/2' 


This  shows  that  P  should  be  chosen  as  the  center  of 
the  circumscribing  circle,  as  stated  above. 

Instead,  if  P^  is  fixed  in  the  center  of  the  circle, 
and  E^  varies,  we  get 

and  this  proves  the  optimality. 


When  y)  is  obtuse,  we  put  p  =  1 ,  and  P  should  go  to 
the  center  of  the  base. 

In  order  to  prove  these  assertions,  we  first  observe 
that  E,  trying  to  come  as  far  as  possible  from  P, 
always  will  go  to  some  extreme  point  of  the  cone,  either 
to  the  vertex  F  or  to  the  periphery  of  the  base.  If  E 
goes  to  the  vertex  with  probability  1  —  p,  the  proba¬ 
bility  mass  on  the  periphery  will  be  p.  On  that  pe¬ 
riphery,  E  chooses  a  point  from  a  probability  distribu¬ 
tion  over  the  interval  between  -  n  and  I  n.  If  the 
probability  ma.ss  on  the  line  element  rdy,  of  that  pe¬ 
riphery  is  written  as  y((p)  rd<p,  we  must  have 


We  introduce  an  orthogonal  coordinate  system  with 
the  origin  in  the  vertex,  the  x  axis  along  the  axis  of 
the  cone.  Counting  the  angle  <p  along  the  periphery 
from  ihe  positive  y  axis  to  the  positive  z  axis,  any 
point  on  the  periphery  will  have  the  coordinates  x  =  A, 
y  =  r  cos  (p,  z  =  r  sin  (p,  where  q  cos  xp  and  r  =  A  sin  tp. 

The  center  of  gravity  of  the  probability  mass  distri¬ 
bution  on  the  periphery  will  then  have  the  coordinates 
t/=a,  2  =  /9,  given  by 
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voatpdip  ^  px, 


sin  (pd<p=^  p/9. 


last  condition  means  that  if  our  method  of  observation 
has  a  systematic  error,  then  this  has  been  compensated 
for  by  a  suitable  correction.  We  will  choose  as 

Pft  “  c  f  X, 


If  P  goes  to  the  point  (xyz),  the  expected  value  of  the 
squared  distance  Ijetween  P  and  E  will  be 

.S'=(l-p)(x*  t  2*) 

+  j*  [(A  -  x)*  ‘  {rQoa(p-y)*+{ra\n(p-z)'^]ry((p)d(p 
=  (x  -  phf  +  (y  -  pa)*  (  (2  -  p/9)*  +  p(r*  +  A*) 

Here  P,  l)eing  able  to  choose  the  parameters  x,  y,  and  z, 
can  minimize  S  by  putting  x  pA,  y-=px,  and  2  ^  p/9. 
He  will  thus  go  to  a  point  on  the  line  between  the 
vertex  and  the  center  of  the  distribution  on  the  pe¬ 
riphery,  such  that  the  distance  to  the  vertex  is  p  times 
the  length  of  the  whole  line.  The  minimized  value  is 
then 

min  iS  =  p(r*  +  A*)  -  p*  (A*  +  a*  +  /9*). 

p 

Now  E,  being  able  to  choose  the  parameter  p  and 
the  probability  distribution  on  the  periphery,  wants  to 
maximize  this  expression.  This  will  mean,  first  that  he 
puts  a  =  /9  =  0,  i.e.,  that  he  chooses  a  probability  distri¬ 
bution  with  the  center  in  the  center  of  the  base,  and 
second  that  he  puts  p  equal  to 


where  x  is  a  vector  that  can  be  stochastic  or  fixed. 
In  both  cases  it  can  bo  described  by  a  probability 
distribution  P>(x),  possibly  degenerate.  Clearly,  Fp  does 
not  depend  upon  e,  since  it  is  chosen  by  P  who  does 
not  know  the  actual  error  of  observation,  e.  We  get 
the  payoff,  with  E^  =  y,  as 

U(Fp,Fs)=  f  f  <p(x-y)dFp(x)dFs(y), 
jEk  JPk 

where 

ffix  y)  J  ||e  I-  r  -  y||*  df(e)  =  E,  \\e  I  x  -  y||* 

^E.|H|*+||x-yll»  +  2E,[e,  (x-y)] 

=  <r5+|lx-yl|*. 

This  gives  us 

U(Fp,Fs)-(^,  ^-(  f  ||x-y||»dFpdF^, 

J  Eh  JPi, 

where  the  first  term  on  the  right  side  is  a  constant 
characteristic  for  the  method  of  observation.  The  second 
term  is  of  the  type  wo  have  met  before.  Therefore 
we  know,  at  least  in  principle,  how  to  deal  with  this 
problem. 


_r*+A*_  _ 1 

^  2A*  2cos*y>/2' 


The  value  of  the  game  is  then 


max  min  S  = 

E  P 


(r*+A*)* 

4A'* 


4C08V2 


The  strategy  adopted  by  P  thus  means  that  he  will 
go  to  a  point  with  the  same  distance  x^p^  to  all  those 
points  to  which  E  can  go. 


S' 


3.6.  Incomplete  Information 

Wo  have  assumed  complete  information  at  time  t-0: 
P  knows  the  position  and  velocity  vector  of  E  with 
no  observational  errors.  Let  us  now  discuss  how  this 
should  be  modified  when  the  errors  of  observation  are 
so  large  that  they  should  not  be  neglected. 

First,  the  simple  but  relatively  uninteresting  case 
where  the  only  error  is  in  the  determination  of  the  posi¬ 
tion  Ej.  We  choose  a  coordinate  system  with  its  origin 
in  The  error  of  observation  is  a  stochastic  vector  e, 
about  whose  probability  distribution  we  assume  only 
that  second  order  moments  exist  and  that  Ef  =  0.  The 


So  far,  we  have  not  allowed  any  error  in  the  de¬ 
termination  of  the  velocity  vector  Eq.  In  many  cases, 
the  error  in  determining  the  direction  of  E'a  trajectory 
is  the  important  one.  We  may  think  of  the  ordinary 
plotting  method.  To  handle  this  angular  error  too,  let 
us  consider  Fig.  8.  For  the  sake  of  clearness  the  figure 
has  been  drawn  wdth  a  very  large  observational  error. 
The  vector  x  can  now  be  written  as 

x=e+Tf. 

Here,  f  is  the  position  relative  to  a  coordinate  system 
fixed  in  relation  to  the  region  S',  and  T  is  a  rotation 
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operator  corrcHponding  to  the  angular  error.  We  have 
a  stochastic  vector  f  in  or  /f*  and  a  stochastic 
orthogonal  operator  T  in  i?*  or  R^.  The  tactics  of  E 
and  P  are  described  by  probability  distributions  Ff^ 
and  For  fixed  values  of  f  and  y,  we  get  the  payoff 

B=E.,r||x-y||*=E..^||e+  Tf-yji* 

=  f  l|el-Tf-t/||*dF(e,7’). 

Jt.T 

where  F{e,  T)  describes  the  simultaneous  probability 
distribution  of  e  and  T.  Hence, 

B  =  E..r  Ikll*  +  E,,  I|rf  -  t/ip  ==  (T?  -I-  E.,r  m  -  y\\\ 

where  of  is  a  constant.  To  get  some  idea  of  how  the 
second  term  differs  from  the  cases  we  have  studied,  we 
consider  the  plane  situation,  x  and  The  nota¬ 

tion  is  given  in  Fig.  9. 


Fig.  9.  Observational  error  in  the  plane  case. 


We  get 

-  Ilf  ll‘  +  ll»ll’  “  2||f  II  ■  ll^ll  008  (a  +  tp) 
and 

«..r II rf -  y||‘-  llfll*  +  ||y||‘  -  2||{||  •  ||y|i  9  oo8  (.  I  f,). 

Here  we  have  defined  the  non-random  quan.tities  d  and 
fo  through  the  relations 

j*  cos  (p  dF{(p)  =  0  cos  (fg, 

sin  q)  dF{(p)  =  d  sin  qg. 

With  no  systematic  errors,  the  quantity  fg  will  be  close 
to  zero,  whereM  0  can  differ  considerably  from  1.  We 
have  to  study  the  payoff  function 

lkll*+W-20|kli-ycosa 

instead  of 

ikir+ iHr-2||fii  y  cos  a. 

Apparently,  the  angular  eiTor  affects  the  problem  in  a 
way  that  does  not  lead  to  complications  in  principle. 
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Errors  in  the  determination  of  ||/?o||  could  also  be 
imporf^nt.  The  possible  region  for  does  no  longer 
behave  as  a  rigid  body:  S'  is  not  necessarily  congruent 
with  (S'.  The  length  of  S'  (in  general  funnel-shaped) 
depends  upon  how  close  (|^o||  is  to  its  largest  value, 
the  maximum  speed.  Wo  shall  not  enter  into  a  discus¬ 
sion  of  such  modifications;  if  the  applications  seem  to 
require  such  an  extension  it  seems  to  bo  ^(ossible. 

We  can  incorporate  into  the  model  the  possibility  of 
navigational  errors  of  P.  Let  us  say  that  P  aims  at 
P;,,  but  that  the  position  really  reached  is  +  <5,  where 
d  is  a  stochastic  vector.  Assume  that  E(5  =  0  and  that  6 
is  independent  of  P,^.  We  then  get  the  payoff  function 

E,||£-n-9||‘-||£-  P,r  .  £,||a||* 

It  differs  from  the  previous  formula  only  by  an  additive 
constant. 

3.6.  Several  Pursuers 

When  we  have  mere  than  one  pursuer,  we  meet  a 
more  essential  modification.  Say  that  we  consider  the 
two  pursuers  Pj  and  Pj.  As  usual,  their  optimal  be¬ 
havior  will  depend  upon  what  payoff  function  we  use. 
This  will  reflect  the  purpose  of  the  pursuers  very  clearly 
and  with  direct  and  practical  consequences. 

For  simplicity  we  will  chose  S  as  the  interval  (0, 1 ) 
and  consider  the  two  payoff  functions 

5.-l|fi-f.ll'.  1 

B.-||£-P,||’.  j 

They  measure  the  value  of  the  achievements  of  Pj  and  P,. 

Let  us  first  see  what  happens  if  the  total  payoff  is 
simply  the  sura  8  =8^  +  P,  of  the  individual  ones.  The 
two  pursuers  P^  and  Pj  play  two  identical  games.  P, 
and  Pj  shall  behave  as  if  they  were  alone,  and  steer 
toward  the  point  P^  =  E  shall  choose  one  of  the 
points  Pa  =  0,  E^=\,  with  probabilities  J,  J. 

If,  instead,  B=  max  (P,,  P,),  we  get  the  same  result. 
To  see  this,  let  E  behave  as  described,  and  P,sSP,, 
then 

payoffs  J  (1  -  Pi)*  +  i  P*  ^  i. 

Instead,  if  P,  =  Pj=J,  we  get 

payoff  =  (P  -  J)*<i, 

which  verifies  the  statement;  the  value  i'=J. 

Finally,  if  we  choose  P=  min  (Pj,  P,)  we  get  another 
result,  but  it  will  not  be  discussed  here. 

There  are  of  course  many  other  situations,  but  these 
three  illustrate  some  typical  cases.  The  first,  P-=  P,  +  Pj, 
implies  an  additive  effect.  It  could  be  rca.sonable  when 
we  study  the  expected  number  of  hits.  It  could  also 
be  relevant  in  hunting  submarines,  if  the  total  pressure 
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effect  on  the  Hubmarine  is  approximately  equal  to  the 
sum  of  the  individual  pressure  components.  In  recon¬ 
naissance  it  might  also  be  used,  or  |M>rhaps  the  more 
precise  formula  li  I  li.,  The  second  case, 

=  max  (fl,, /jj),  could  be  relevant,  if  the  total  effect 
B  depends  upon  the  worst  (largest)  result  of  By  and 
The  third  cast*,  B=  nun  (By,  B^),  is  based  on  the  best 
(smallest)  result  of  By  and  B.^.  It  will  lead  to  the  well 
known  notion  of  artificial  dispersion  that  apix-ars  in 
artillery  tactics. 

3.7.  Critici.'im  of  the  Besults 

It  «  possible  to  critiettc  the  disercle  formulation  ot 
the  problem  that  we  have  adopted  in  this  chaptcT.  In 
the  disrufMon  «•  have  aasuuuil  t  ha?  t  hr*  fkiiit  of  linm 
h  is  fixed  and  known.  If  this  is  not  so,  the  region  S 
is  no  longer  determined  by  kinematic  data,  and  the 
previous  reasoning  is  not  applicable  directly.  If  h  has 
a  probability  distribution  known  for  E  and  P,  then  we 
can  take  into  account  the  variability  of  h  without  essen¬ 
tial  modifications.  Otherwise,  we  get  one  more  game 
parameter,  h.  In  spite  of  its  obvious  importance,  we 
shall  not  discuss  this  possibility. 

Another,  more  e.s.sential,  objection  to  the  discrete  point 
of  view  48  the  following.  After  time  h  the  bombardment, 
or  the  reconnaissance,  etc.,  has  l)een  completed.  But  in 
general  we  will  still  be  interested  in  E  and  P  and  in 
what  happens  to  them  afumranls  I’lrhaps  the  game 
is  repeated  over  and  over  again.  We  get  a  sequence  of 
cycles  of  more  or  less  similar  type.  If  these  cycles  can 
be  assumed  to  be  approximately  independent  of  each 
other,  then  we  could  just  apply  the  discrete  model 
several  times.  Very  often,  however,  do  we  liave  inter¬ 
dependence  between  the  cycles.  This  is  clear  when  the 
quantities  A,,  ...  are  not  known  inadvatiee.  Let 
us  assume,  e.g.,  that  in  a  naval  situation  E's  best  tac¬ 
tics  is  to  steer  port  or  starboard  (with  probabilities  J,  J) 
with  maximum  angular  velocity  during  the  time  h.  If 
we  have  several  consecutive  cycles  it  might  be  optimal 
to  keep  the  angular  velocity  constant.  But  then,  P  could 
predu‘1  Ihi  bhaviur  of  t!  already  ufur  Uir  Lir^t  ryrh 
We  must  look  more  carefully  into  the  way  the  cycles 
influence  each  other. 

Our  aim  is  then  to  study  a  seqaen-je  of  cycles  of  in¬ 
dividual  games.  It  seems  to  be  a  good  starting  point 
to  investigate  a  cuntinwttin  tif  cycles,  tliis  can  be  said 
to  correspond  to  the  ca.se  where  A,,  h^,  h^,  ...  are  un¬ 
known. 


4.  THK  (’ONTlNUOrS  Al'l'KOACll 
4.1.  (leneral  Von-ndertitions 

Let  us  .study  tile  following  typical  situation.  The 
cvadtT  E  moves  along  some  curve  A’,  the  form  of  which 
is  subject  to  kinematic  restrictions  as  discussed  in  Chaj)- 
ter  2.  At  time  t  the  pursuer  P  has  more  or  less  com- 
j)leto  knowledge  of  the  curve  E,  for  n-'t.  Using  this 
knowledge,  P  makes  a  jjredietion  Pyj,,  a  predicted  im¬ 
pact  point  or  whatever  one  chooses  to  call  it.  In  a 
certain  sence,  P^  ,^  can  be  said  to  approximate  A’,,;,. 
Measuring  the  result  by  a  payoff  function  B{Et^,^,  P<,;,), 
we  have  again  an  extremal  problem.  Here  E  controls 
the  ehuicc  ed  trajectory  A’,,  or  rather,  he  ch»«)scs  the 
probability  distribution  governing  the  stochastic  pro- 
cc?«  Ey.  P  cbmw»-s  the  tnt-tbrtd  of  pfedittlim.  The  rVtnVs 
may  turn  out  something  like  Fig.  10,  where  Pyj,  is  the 
dashed  line.  The  arrows  denote  the  errors  of  predic¬ 
tion,  to  u.se  a  term  that  is  not  entirely  adequate. 


If  the  pn»l»lem  luw  not  hreT,  qxTifktl  in  mon"  detail 
it  is  difficult  to  say  anything  general  about  what  op¬ 
timal  tactics  to  use.  It  is  clear,  however,  that  the  evasive 
trajectories  A\  must  not  form  a  highly  regular  system 
of  functions.  Indeed,  if  the  trajectories  were  regular 
enough  (analytiiity ,  etc.j,  the  pursuer  could  predict  the 
future  positions  of  E  without  error;  at  least  this  is  so 
if  we  ntgltct  ob8t?rvalkmal  muts.  Suvh  a  cximpkte  pre  ¬ 
dictability  is  obviou.sly  unrealistic.  The  path  Ey  must 
be  allowed  to  be  more  irregular.  This  can  express  itself 
in  different  ways,  e.g.  that  derivatives  may  not  exist 
for  orders  greater  than  one.  Sometimes  we  will  be  led 
automatically  to  .such  classes  of  function  Ey  when  we 
«olw  th4'  4-  lUivwnI  prolAni  ijneb  ckknwi's  ci  (4444Ctk»u 
often  very  wide  and  not  compact  under  natural  topol¬ 
ogies.  This  introduces  difficulties,  since  we  cannot  in 
general  apply  the  fuiidamental  theorem  o!  game  theory 
under  the.se  conditions.  Difficulties  remain,  even  if  we 
iimit  uiirseHes  to  the  ilrtinninatiuii  a!  a  max  min  solu¬ 
tion.  While  the  rea.soiiing  in  Chapter  3  was  based  on  en¬ 
tirely  elementary  mathematical  facts,  we  will  need  some¬ 
what  more  sophisticated  ideas  iri  the  present  chapter. 

4.2.  One-dime nsioruil  Pursuit 

We  start,  of  course,  with  a  one-dimensional  problem. 
E  moves  along  the  real  line  with  the  trajectory  Ey.  We 
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(oii.sidcr  A  s  v<-l()(ily  v{t)  dK,  ill  as  coinposcd  of  fuo 
parts,  V  and  //(<),  v{t)  r  *  //(/),  'I’lif  first  term,  v,  is  a 
constant  and  corresponds  to  the  fact  that  K  tnoves 
accordini^  to  some  j'ivtm  {)nrposc.  It  may  l)e  a  tank 
advancing'  aj'ainst  the  cncni}’.  'I’o  avoid  l)cin^' hit  wliilci 
ad  vancin^  he  makes  evasive^  maneuvers.  The  tiim*  points 
when  the  individual  shots  are  finsl  nj^ainst  K  are  not 
known  hy  liim  in  advance.  The  term  y(t)  describes  the 
attempts  to  evade.  These  values  (positive  or  negative) 
are  added  to  an  average  value  v.  We  shall  assume  more 
j)reci.sely  that  y{t)  forms  a  stationary,  stochastic  {)roeess 
with  mean  value  zero.  Such  an  assumj)tion  may  seem 
rca.sonahh',  but  it  is  nmre  difficidt  to  motivat<‘  the 
choice  of  particular  j)robal)ility  distributions  for  //(/'. 
Therefore  we  shall  only  assume  that  y{l)  has  a  covari 
ance  function  r(t)  corresj)onding  to  a  sp<‘ctral  distribu¬ 
tion  function  F{X),  so  that 

Ey{t)  0, 

r{t)  -  Ey(.'i)y{.H  *  0  J  coh  tX(iF{X). 

The  kinematic  restrictions  make  it  improbable  for  |i/(/)| 
to  take  large  values  under  long  time  intervals.  Let  us 
formalize  this  statement  as 

r(0)  =  Ey'(0'^C'. 

We  shall  return  later  to  this  condition  and  discuss 
alternative  forms  of  it.  The  set  of  strategies  is  here 
the  set  of  all  non-decreasing  functions  F{X)  whose  varia¬ 
tion  does  not  exceed  C. 

As  far  as  P  is  concerned,  we  shall  study  first  what 
happens  when  he  uses  a  linear  first  order  predictor  as 
follows.  The  value  of  Ej  i;.  observed  at  equidistant 
points  of  time  Ip  n.  The  observed  values  of  E„  and 
E„  1  are  used  to  predict  + 

a:,,  E„  +  (E,-E„  .)-2A„-A„.,. 

The  formula  is  exact  for  uniform  motion.  We  get  the 
extrapolation  error 

En  1 1  —  E*  E„ ,  i  —  2E„  E„  1, 

a  second  order  difference.  The  mean  square  error  a* 
is  then 

r  en  t 1  Cn  12 

=  E  (i;  I  y(t))dl-  (i;+  y(t))(U 

LJ  n  J  n  I 

^  E  M  y('‘')  k(s)  d.s  , 

where  the  functi'  k{s)  -  1  in  the  interval  (n,n  i  I)  and 
k{s)  -  -1  in  (n-l,n).  This  gives  us 


d  t  I  /•  n  ♦  I 

-  r(s  t)  k{.s)  ki^d-ndl 

J  n  i  J  n  1 

f  j*  f  COS  [(,<j  t)  X]dF(X)  k{/<)  k{t)  (Li  dl. 
J  n  \  J  n  \  J  H 

('hanging  the  order  of  integration,  we  find 

nn  ♦  I  /•  n  »  1 

I  coh[(.s  -  t)  X]  k(.i)  k(t)  (Is  dt  dF(X) 

n  I  J  n  I 
=  |“x(A)dA(A). 


Here  we  have  introduced 


x{X)  ■ 


^  n  t  1  ^  n  ♦  1 

J  n  \  J  n  1 


cos  [(,y  -  t)  A]  k(.i)  k(t)  ds  dt. 


Substituting  t  s  u, 


i  \  ^v-f  n>l 
J  n  1  J  u-l  n  I 


COS  uX  k(s)  k(3  -  u)  du  ds. 


Changing  the  order  of  integration  gives 

^1  n  t  I 

x{X)  2  cos  wA  k(s)  k{s  -  u)  ds  du 

Jo  Ji-n  Ifu 

r 

=  2  cos  uX  h(u)  du. 

Jo 

Here  the  function  h(u)  is  computed  as 
(a)  0<  a<  1: 

rn  +  I 

h(u)  =  k(s)  k(s  -  u)ds 

J  n  -  1  +  u 

Cn  +  1  (“n 

=  it(s  -  m)  d.9  -  k(s-u)ds 

J  n  J  n -  1  +  u 

/•n  +  1  u  ^n-u 

=  I  k{:)  dz  —  I  Jfc{z)  dz 

J  n  -  u  Jfi-1 


=  (l-u)-u+l-w  =  2-3u, 


(b)  l<u<2: 


en  4  1 

h(u)  =•  k(a  —  u)ds 

J  n  -  1  +  u 

+  I  - u 

=■  k{t)  di  =  {n  —  l)  -  (n  +  l  -  u)  ”  u  -  2, 

J  n  1 


so  that 


h(u)  = 


2  -  3u,  0<  u<  1, 
u-2,  l<u<2. 


The  form  of  the  function  h(u)  is  seen  in  Fig.  11. 
We  have  to  solve  the  variational  problem 


^00  1*0 
a*  x(X)dF(X)  max,  dF(?.)^C. 
J  <  F  Jo 
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Fig.  11.  The  function  h(u). 

Since  C~^F(X)  is  a  distribution  function,  it  is  clear  that 
the  maximum  is  attained  by  locating  the  whole  varia¬ 
tion  C  in  the  point  nr  points  where  the  function  x(A) 
has  its  largest  value.  This  function  can  be  written  as 

x{X)  ■=■  [3  -  4  cos  X  +  cos  2A]  ==  4  )  ‘ 


0  nu  nil  ixn  t  st/*  jv/j  7rr/*  it 

A 

Fig.  12.  The  function  x(A). 

x(X',  is  shown  in  Fig.  12.  The  maximum  is  found  from 
the  equation 

This  equation  can  be  solved  numerically,  having  a  single 
root  between  0  and  2;i: 

2.331 ««  133°33'. 

The  corresponding  value  of  x  is 

max  x(X)  =  (2  sin  Aopt)*  2.10. 

X 

We  get  the  minimum  square  error  a*  <^2.10  6'. 


Hence  E  shall  chose  his  velocity  as 
v(t)  -  e  -I  \'C  cos  (Aopff  4-  (p), 

where  g[)  is  a  phase  angle  chosen  at  random  (with  a 
rectangular  distribution)  in  the  interval  (0, 2;i).  The 
resulting  trajectory  is 

\^C 

a;{f)  =  i(0)  i  I'f  -f  —  8in(Aopi  <  +  9?). 

^pt 

To  achieve  some  realism  it  may  be  necessary  to  impose 
some  restriction  on  the  acceleration  v(t),  rather  than  on 
the  velocity  itself.  If  we  do  this  via  the  condition 


dF(X)<Ci, 


we  wdl  get  a  mo<lification  of  the  previous  variational 
problem.  The  solution  is  simply  found  by  using  Ncynian- 
Pearson’s  lemma.  Put 


I  max  l(X). 

X 


Then,  <r5pt  = and  the  optimum  is  realized  by  lo¬ 
cating  all  the  variation  C,  in  the  point  or  points  wl\ere 
1{X)  attains  its  mar.imal  value  1.  This  follow-s  from 

Jo  Jo 

The  equality  sign  is  realized  in  the  way  just  mentioned. 
The  form  of  the  trajectory  is  easy  to  calculate. 

A  still  more  realistic  formulation  of  the  problem  may 
be  obtained  by  restricting  both  the  velocity  and  the  accel¬ 
eration  by  the  conditions 

^OO 

x(A)dF(A)=  max, 

Jo  F 


variance  of  the  velocity  I  dF{X)  ^  C, 


1*00 

variance  of  the  acceleration  =  I  X*dF(X) 

Jo 

This  is  a  combination  of  the  two  previous  formulations. 
A  simple  variational  argument  is  needed  to  solve  the 
extremal  problem.  Let  us  denote  by  s(F)  the  support 
of  F:  the  set  of  all  points  X  for  which  the  increments 
F(A  +  £)  -  F(A  -  e)  >0  for  every  positive  e.  It  is  seen 
that  s{F)  is  a  closed  set,  and  it  describe.',  the  frequencies 
used  by  E  when  he  forms  the  velocity  function  y(t) 
from  harmonic  components. 

Let  us  assume  that  three  different  frequencies  ^2, 
Xi£s{F).  Choose  a  small  positive  number  e,  and  change 
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F(X)  ill  thii  ((linjoint)  iiitcrvalH  I„  t  ,  A„  »  e)\ 

n-^  1,2,3;  tho  Hpcctral  on<■r^y  in  fli<'H<‘  intiTvalH  Hhould 
bo  incroasod  by  tho  ainounlH  T}r„,  when- 

j-i  I  jj  I  jj  (», 

I  Xix.,  I  Ajrj  0. 

Thia  moans  that  tho  intoj^rals  appearing  in  tho  kino- 
niatic  restrictions  are  little  affected  if  e  is  small  onmif^h. 
If  T)  is  small  enough,  wo  still  have  A /’(/„)  i  rji„  ■<>, 
HO  that  the  now  function  is  still  non-docroasing.  In  order 
that  F(X)  shall  be  tho  solution,  we  must  have 


During  the  above  discussion  we  have  assumed  ini- 
plieitly  that  sup  J”  x(A)  is  realized  by  some  F. 

That  this  is  so,  follows  from  the  fact  that  the  condi¬ 
tion  j*  (A)  •  Y',  implies  that  the  set  of  spectral 
distribution  functions  at  our  disposal  is  w(>akly  com¬ 
pact:  no  Hfiectral  energy  can  "escape  to  infinitely  high 
frequeneies”  when  considering  all  these  F.  From  every 
sequence  of  F  we  can  pick  out  a  weakly  convergent 
subsequence,  and  this  proves  the  assertion. 

iSituatiiins  where  we  introduce  more  side  conditions 
can  be  dealt  with  by  a  direct  generalization  of  the  above. 


x(A,)x,  t  x(Aj,)  Xj  '  X(As)X3  =  (». 


4.3.  A  Moiiification  of  the  Previoiis  Problem 


Othorvise,  wo  could  increase  the  value  of 


x(k)dFa) 


by  replacing  AF  by  AF  1  rjX  in  each  of  the  three  in¬ 
tervals  and  leaving  F  unchanged  elsewhere,  But  this 
implies  that  the  third  relation  must  be  a  linear  com¬ 
bination  of  the  two  first  ones, 

x(A„)  =  o  +  6AL  1,2,3. 

If  we  determine  the  constants  a,  h  from  the  conditions 
for  n  =  1 , 2,  we  get 

®  i2  _  12  > 

x{k2)-x{Xi) 

4-Af  ’ 

or 

x(X) 

^  Xlx[ki)  -  kix{k2)  +  Ixlkz)  -  x(Xi)  \  +  [xjkz)  -  X(A|)]  A* 

Ai-A?  ■■  • 


This  equation  should  be  satisfied  for  A  =  Aj,  A2,  A3.  Assume 
that  s(F)  consists  of  at  least  two  points  A,,  A2;  the  oppo¬ 
site  case  could  be  dealt  w'ith  directly.  Since  the  above 
relation  must  hold  for  every  A€s(F),  and  since  F  has 
no  variation  outside  s(F),  we  get 


Let  us  now  return  for  a  moment  to  the  situation 
with  the  only  restriction  j^dF(k) '  C.  It  is  quite  natural 
to  use  the  linear,  first  order  predictor  that  was  sug¬ 
gested,  but  it  may  be  argued  that  one  should  not  choose 
tho  predicted  value  of  ,  1  all  the  way  E„  F„  ,  from 
the  last  observed  value  F„.  Instead,  P  may  do  bett^ir 
by  using  the  modified  predictor 

f x)  +  v(l-k), 

where  k  is  some  constant  to  be  chosen,  presumably  in 
the  interval  (0.  1).  The  last  term  has  been  added  to 
make  the  prediiitor  unbiased.  The  error  of  prediction 
is  then 


(T*  — E(F„  +  i  Fj  +  i)* 
=  E 


IJ  [t;  +  y(«)](ia-i;(l  -  A:) 

Proceeding  as  before,  we  get 

^00 

0’*=  J  xif(k)dF{k), 


where  X;-(A)  =  a(A) -t  A/?{A)  +  i(:*y(A), 

with 


/*  00  /*00  /*  00 

x(A)dF(A)  =  a  JF(A)  +  6  A*dF(A)  <aC  f  6C,. 

Jo  Jo  Jo 

The  equality  sign  can  be  realized  if  s(F)  contains  some 
point  Then  we  should  determine  A;  and  A2 

such  that  they  maximize 

C[k\x{kx)-k\x(k2)]  4  C,[;^2i- >dA,)] 

Ai-A? 

with  min  (Aj,  A2)  <  (Cj/C)*.  We  have  thus  reduced  the 
problem  to  a  finite-dimensional  maximum  problem. 
While  this  may  present  some  minor  numerical  diffi¬ 
culties,  it  is  clear  that  it  is  simple  in  principle. 


a(A)=y(A)' 


2(1-  cos  A) 


,  2(1  -  2co8  A+ C082A)  4co8A(1  -  cos  A) 

m —  -  - - 


Intrrjduce  the  quantities 


dF(k), 
2  cos  A  4  cos  2A 


dF(A). 


The  possible  positions  of  the  point  (a, /9)  in  the  plane, 
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when  dF{X)  '  C,  form  a  region  I).  Apparently,  D  is 
convex  and  compact.  Further,  for  any  probaliility  dis¬ 
tribution  function  K{k)  of  the  parameter  k  in  (0,  1), 
introduce  the  moments 


lojry/'A/ 
^  2 


The  point  (//g, /ij)  situated  in  some  convex  and 
compact  region  F.  The  reader  may  note  that  the  con¬ 
cept  of  moment  spaces  could  be  used  here,  but  we  shall 
assume  no  knowledge  of  this  concept.  The  payoff  be¬ 
comes  simply  a/ig  t  t  Hence,  optimal  strategies 
exist,  say  F  and  (/io,  ^i< /^2)-  The  latter  must  correspond 
to  a  pure  strategy  since,  if  and  /x,  have  been  fixed, 
wo  have 

kh  \kh' 

Here  equality  holds  for  that  pure  strategy  where  K{k) 
has  all  its  variation  in  the  point  k  -=  To  get  the 

payoff  as  small  as  po.ssible  wo  shall  make  /x,  as  small 
as  possible,  since  its  coefficient,  y,  is  positive.  We  can 
write  down  an  algorithm  for  determining  F  and  k. 
C!omputc  Xk(X)  and  its  maximum  x*  attained  at  A  A*. 
Choose  k  such  that  Xk  is  made  a  minimum 


mm  x*  =  Xk„ 

k 

Aopt  ~  ^k,  • 


The  optimal  prediction  constant  is  then  k^k^,  and  the 
velocity  should  be  chosen  as 

Et  =  V  VC  coa  (fAopt  +  (p)- 

It  has  the  same  form  as  before,  but  with  a  different 
frequency. 

We  can  write  Xk(A)  as  a  function  of  two  variables, 
k  and  A: 

=  '  I:*)  -  21:  cos  A]. 

4(1  cos  A)  , 

^3  [(1  •  A-*) -- 21- cos  AJ. 

After  introducing  A:  =  cos  A  into  the  latter  expression, 
it  will  vanish  either  if  A  (*,  or  if  A  satisfies 

.  2  sin  A 

1  t  J  cos  / 


0.2  0.4 


0.a  .  1.0 

k 


Fig.  13.  ^  ^  function  of  k. 

This  equation  can  be  solved  graphically,  yielding  Aopt 
1.446.'),  A'o^  0.1240,  and  niiiik  max^  Xk  (A) 0,8245. 

Fig.  13  shows  max,iXk(A)  as  a  function  of  k.  For 
A- <  (7  -  4  13)  0.07180,  the  maximum  occurs  for  A  =  0 

and  is  of  the  simple  form  (1  — A-*).  For  k  exceeding 
that  value,  the  function  first  decreases  to  a  minimum 
0.8245  for  A  -  Ao  and  then  increases  again  to  2.1002 
for  A  =  1 . 

4.4  Other  Types  of  Restriction 

In  certain  problems  one  might  prefer  to  introduce 
the  re.strictions  on  velocities,  accelerations,  etc.,  in  a 
different  way.  Instead  of  restricting  their  mean  square, 
one  may  prefer  to  restrict  their  absolute  values.  It  is 
clear  that  this  could  lead  to  a  more  realistic  treatment, 
but  also  that  it  requires  a  more  detailed  specification 
of  the  stochastic  proces-ses  involved.  It  will  no  longer 
be  sufficient  to  describe  the  covariance  function.  To 
show  how  this  can  be  done  wo  shall  study  a  specia'. 
case  of  some  importance. 

We  can  always  neglect  the  presence  of  a  constant  and 
known  velocity  component,  since  such  a  component  can 
be  taken  into  account  through  a  simple  correction  term. 
Ivet  us  assume  that  E  uses  all  of  the  remaining  varia¬ 
tion,  .so  that  i’(f)  takes  only  the  two  values  +  v.  Wo 
assign  the  probab’lity  p  to  the  plus  sign  and  the  prob¬ 
ability  7^1-p  to  the  minus  sign.  Denote  by 
f„,  t„^l  the  points  of  time  when  ii(f)  can  (but  need  not) 
change  sign.  We  shall  assume  that  in  each  interval 
f n  (frt  i,<n)>  choosc  oiic  of  tlic  two  signs  independ¬ 
ently  of  what  happened  in  the  other  intervals.  We  also 
assum"  that  the  length  fn  1 1  ~  arp  .stochastically 
independent  and  have  the  common  distribution  func¬ 
tion  F{x).  Such  a  point  process  is  called  a  renewal 
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process.  That  particular  point  process  when*  F(r)  is  an 
exponential  distribution  is  well  known  and  can  be  treated 
lH*cause  of  its  Markovian  j»rojK*rty.  Then*  is  no  reason, 
however,  to  limit  ourselves  to  that  ])rocess.  In  order 
that  our  process  shall  be  completely  sjKJcified,  we  must 
also  start  it  off  by  choosing  a  probability  di.stribution 
(r(r)  for  the  time  betv  een  t  -  0  and  the  next  random 
point  among  the  t„.  We  deal  oidy  with  stationary  pro¬ 
cesses  here,  and  then  it  is  known  from  the  general  theory 
of  retiewal  processes  that 


G(y)  ■  ^  |1  -  /’(a:)]d2-, 

tn  Jo 


where  m  is  the  mean  vahn* 

/•oo 

mix  dF(x) 

for  the  time  between  two  successive  points  of  time  t„, 
+  1- 

Let  us  now  compute  the  covariance  function 

r(0  =  E[v(«)  t;(s  I  f)]  -  [I  -G{t)]v^  t  G{t)  v^(p  - -jf, 

where  the  first  term  on  the  right-hand  side  corresponds 
to  the  event  that  no  falls  in  the  interval  (.?,  s  1  t), 
and  the  second  term  corresponds  to  the  complementary 
event.  Hence, 

If  wo  still  use  the  simple  predictor  £„  -t  (E„  -  E„  .i), 

ve  get  the  error  of  prediction  as  before: 


Such  a  function  can  Iw  represented  as 
//(u)  lju)d(f>(a). 

Hero  wo  have  used  the  broken  linear  functions 


1  -  ,  0<  u<  a, 
a 

0,  u>a, 


and  a  distribution  function  <f>  on  the  positive  rjal  line. 
To  maximize  the  integral 

f  H{u)h{u)du=  f  [1  -  6'(m)J  A(M)d«  =  —  (  G(u)h{u)du, 
Jo  Jo  Jo 


we  consider 


which  is  a  continuous  function  of  a  tending  to  zero  as 
a  tends  to  infinity.  Denote  by  Uq  the  root  (or  one  of 
the  roots)  of  the  equation  Xa  ^  max.  We  get 

C2  ^00 

H(u)h(u)du  /'.^d<f>(a) 

Jo  Jo 

and  it  is  obvious  that  the  maximum  Xa,  is  realized  by 
placing  all  the  mass  of  <f>(a)  in  the  point  a=aQ.  If 
o  >2,  we  get 


so  that 


r  r n  +  I  I* 

If  1  <  o 

E  1  *’(<)  k{f)ds 

LJn-l 

r* 

Aa  = 

=  2  r{u)h{u)du, 

Jo 

.SO  that 

with  the  same  meaning  for  and  h(u).  We  shall 
maximize  a*,  i.e.,  minimize  the  expression 

[1  -  (p-'7)*]J^  (G(u)h(u)du. 

Since  the  integral  is  always  negative  (use  the  fact  that 
G{u)  is  non-decreasing  and  the  mean  value  theorem  for 
integrals),  we  shall  maximize  which  is  done 

by  choosing  p^^q  The  rest  of  the  problem  demands 
a  longer  but  not  complicated  argument.  The  function 
//(«)  1  -  G(u)  has  the  propertic.s 

(a)  //(0)  =  0, 

(b)  //(m)  is  non-increasing, 

(c)  H(u)  is  convex. 


1  r* 

'  =  -i  I  uh(u)du  <  0. 
a  Jo 


^  ■  I,  (‘  "i)  *  '  I,  "a) 

.SO  that 

dAa  ^  I*  ^2u-  3u*)du(  f  {«*  '2u)du 
da  Jo  J I 

=  i(a*-3a*  t  2)<0. 

Finally,  if  0<o<l,  wo  get 

Aa  =  j*  ^1  ^u^)dn. 

so  that 

dx 

a*  “=  I  (2«  3«*)dM  "a*(l-a)>0. 

d<i  Jo 


This  means  that  1,  and  this  is  the  unique  value 
making  Xa  a  maximum,  since  An  A^  0.  Under  the 
given  conditions  the  optimal  evasive  tactics  consists  in 
choosing  one  of  the  two  directions  (d  motion  with  the 
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samo  probability  J  for  each,  and  in  chooning  tho  time 
between  BUCcoHsive  l„  according  to  a  probability  die- 
tribution  such  that 

//{u)=l-G'(u)-/,(u). 

This  means  that  G(u}  =  u,  0<«<1  and  0(0)=!  for 
u>l.  The  corresponding  form  of  F(u)  is  then  F{u)=^ 
0  for  u<  1  and  F(u)=l  for  «>1,  so  that  the  times 
+  should  bo  constant  and  equal  to  1.  The  only 
random  element  in  this  renewal  proccsc.  is  that  the 
initial  value  should  be  chosen  from  a  rectangular 
distribution.  Tho  extrapolation  error  is 

(r*=2t;*j*  -  v)  h(u)  dll  =  V* . 

We  could  pose  n  game  problem  here  too,  but  we  shall 
not  discuss  this  any  further. 

4.5.  Two-dimemional  Pursuit — Simple  Models 

When  we  turn  to  evasive  maneuvers  in  the  plane, 
things  become  a  good  deal  more  difficult.  One  reason 
for  this  is  that  we  have  so  much  more  freedom  in  con¬ 
structing  the  models  for  the  motion  of  E  and  P.  Be¬ 
cause  of  the  lot  of  alternatives,  it  seems  impossible  to 
formulate  a  theory  that  is  both  general  and  informa¬ 
tive.  Instead,  we  will  have  to  limit  ourselves  to  ana- 
l3rzing  separate  cases,  and  we  shall  try  to  select  these 
so  that  they  illustrate  typical  situations.  Even  so,  we 
will  meet  some  analytical  problems,  some  of  which  seem 
to  merit  attention  because  of  their  intrinsic  interest. 

P _ _  £ _ ^ 

V  . 

Fig.  14.  The  simplest  two-dimensional  case. 


\ 

\ 

\ 


Fig.  15.  Constant  speed  and  alternating  course. 


wants  to  steer  towards  some  region  R  in  tho  direction 
a  =  0,  where  a  is  an  angle  referred  to  some  fixed  di¬ 
rection,  see  Fig.  16.  Suppose  he  travels  at  constant 
speed  r,  but  is  exposed  to  continuous  gunfire,  bom¬ 
bardment,  etc.  To  avoid  being  hit  he  makes  turns, 
Aa,  =  a,+i  -  oe»,  at  certain  points  of  time,  say,  equidis¬ 
tant  for  simplicity.  Under  fairly  general  conditions  we 
can  express  the  probability  that  a  certain  salvo  (bomb, 
etc.)  hits  E  SLB  a.  function  p(Aa).  Usually  this  function 
will  be  decreasing  in  |Aa|.  E  will  try  to  keep  down 
the  value  of  this  function.  At  the  same  time  he  wants 
to  keep  down  the  time  it  takes  to  reach  the  target, 
which  means  that  cos"‘  a  should  be  kept  as  close  to  1 
as  possible.  The  average  number  of  hits  will  be  pro¬ 
portional  to  the  expression 

r  1  1 

a=E  - p(a,u  -0,^1, 

; cos  a,  j 

it  should  be  minimized  by  E.  Supposing  the  evasive 
motion  to  be  stationary,  we  shall  minimize 


Consider  the  two  opponents  E  and  P  at  the  time 
<  =  0,  when  the  distance  between  them  is  denoted  by  R. 
As  usual,  we  denote  their  maximum  speeds  by  v  and 
V,  respectively,  with  the  speed  ratio  k=V/v>\.  If 
there  are  no  other  restrictions  on  their  motion,  it  is 
clear  that  the  pursuer  will  reach  the  evader  after  a 
finite  time.  Tho  game  is  definite  with  the  value 
R/{V+v)  if,  as  before,  we  use  as  payoff  the  tiiue  till 
capture.  The  optimal  behavior  is  for  P  to  move  at 
maximum  speed  towards  E,  and  for  E  to  move  at 
maximum  speed  away  from  P,  see  Fig.  14.  This  simple 
result  can  be  modified  to  fit  the  situation  where  the 
two  players  are  restricted  to  certain  regions.  It  does 
not  seem  probable  that  such  results  will  be  of  much 
practical  use. 

Let  us  include  some  more  factors  in  the  formulation 
of  the  problem.  Usually,  E  tries  to  reach  some  target, 
to  steer  in  a  certain  direction,  etc.  Let  us  say  that  he 


o  = 


P(x-y)dF(x,y) 

COB  X 


under  the  condition  that  the  marginal  distributions  of 
a,  and  (x,+i  are  equal: 

F(x,  7i/2)  -  F(x,  -  nl2)  =  F{7i/2,  x)-F(-  7i/2,  x). 


Here,  F{x,  y)  denotes  the  joint  distribution  of  oc,  and 
a,+i.  The  minimum  is  attained  if  p(Aa)  is  a  contin¬ 
uous  function. 

If  wo  assume  instead  that  the  behavior  should  be 
reversible  in  time,  so  that  F  is  a  symmetric  distribu¬ 
tion,  then 


a  = 


1 

cos  y 


p{x-y)  dF{x,  y), 


where  the  integration  shall  be  carried  out  over  the  half 
square  x<y,  \x\<^7i,  |y|<i:r.  To  find  the  minimum. 
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wr  consider  the  fK)int  (or  jx)intH)  (z,  y)  for  which 


1  1  1 

-  -  -I-  ■ 

cos  X  cos  y 


p(x  -  y)  min. 


If  (^o>  ®  IKjint,  we  get  n  symmetric  distri¬ 

bution  F  by  placing  the  mass  J  in  each  of  the  points 
(^o-yo)  (yo'*)-  other  words,  the  evador  steers 

altornatingly  along  the  course  Iq  and  the  course  y^^. 
The  initial  direction  is  chostui  among  these  two  with 
probabilities  J,  J.  Note,  that  this  behavior  is  essential¬ 
ly  deterministic.  This  is  because  the  prediction  method 
of  P  has  been  fixed  implicitly  by  the  choice  of  the  func¬ 
tion  p(Aa).  If  the  method  of  prediction  is  also  allowed 
to  vary,  wo  get  a  game  situation,  and  this  will  force 
E  to  use  a  truly  stochastic  behavior. 


4.6.  A  More  General  Model — Behavior  of  the  Etnukr 

Wo  now  leave  this  primitive  model  of  evasive  ma¬ 
neuvers  and  turn  to  a  more  general  and  flexible  system. 
We  wish  to  describe  the  motion  of  E  when  he  travels 
in  the  plane  with  the  constant  speed  v  but  with  a 
(randomly)  varying  course  <pi.  Choose  a  coordinate 
system  (x,,X2)  where  the  Xj  axis  will  be  taken  as  the 
average  direction  of  E's  motion,  see  Fig.  16.  Choose  the 
origin  so  that  at  time  <  =  0,  we  have  x,(0)  =  x,(0)  =  0. 


Fig.  16.  Constant  speed  and  continuously  varying  course. 


We  then  have 

*i(0  ^  I  8**^  fi 
Jo 

Zf(t)  =  V  I  cos  (p,  da. 
Jo 


governed  by  a  noise  generator  with  tint  outsignal  f(u) 
that  is  fed  into  a  linear  filter  with  the  resjKjnse  func- 
tiot)  The  outsignal  of  the  filter  is  the  course  angle  f,. 
For  a  complete  description  of  the  probabilist  c  struc¬ 
ture,  we  must  know  the  distributions  of  {(u),  on  < 
u<  on.  The  most  convenient  way  to  describe  such  a 
distribution  is  to  use  the  characteristic  function  of  ^(«), 
which  can  Im)  writt<-n  as 

yiz.u)  E 

The  process  f(u)  being  time  homogeneous  and  with 
independent  increment,  this  can  be  rewritten  as 

V(2,  u)  = 

when'  yiz)  is  some  function  of  z. 

According  to  the  famous  theorem  of  L<5vy-Khinchin, 
one  can  represent  y(z)  in  terms  of  a  certain  integral, 
but  we  need  not  do  this  here.  The  only  restriction  ct 
the  moment  is  that  ({u)  shall  have  a  symmetric  dis¬ 
tribution,  BO  that  xf>(- 2,u)  =  xf{z,u),  or  y(-z)^y(z). 
If  desired,  one  can  remove  this  restriction  with  little 
difficulty. 

The  most  important  special  case  is  when  {(u)  has  a 
no.'‘mal  distribution,  so  that 

V>(2,u)"exp  (-“!)• 

We  then  know  that  ^(«)  is  a  continuous  function  with 
probability  one;  actually  this  case  is  the  only  one  with 
this  property.  It  is  not  differentiable  in  the  usual  sense. 

Another  important  case  is  when  f(u)  changes  ab¬ 
ruptly  with  the  jumps  +(J.  The  distribution  of  f(u)  is 
then  composed  of  two  Poisson  components 

y)(z,  u)  =  exp  [uX(e*^‘-  1)]  exp  1)], 

y(i)  =  X(e*^‘  -l)  +  X(e-**‘-l)  =  2X{coadz-\). 

Concerning  the  response  function  g(u),  a  common  as¬ 
sumption  is  to  postulate  the  form 


g(u)  =  Ae“'‘. 


The  angle  ep,  will  be  considered  as  a  stationary  stochas-  This  means  that  we  have  an  RC  filter,  corresponding 
tic  process  written  as  j^e  differential  equation 


<P,= 


g(a-u)d^{u), 


di 


-  offi  4  A 


djit) 
dt  ■ 


using  the  predictive  representation  of  the  process.  Here 
f(u)  is  a  tin\e  homogeneous  process  with  independent 
increment  and  with  the  variances  E[f(«)  -  f(0]*= 

The  function  g(u)  is  real-valued  and  quadratically  in- 
tegrable.  In  other  words,  the  evasive  maneuvers  are 


Note,  that  the  derivatives  appearing  in  this  equation 
do  not  exist,  but  the  relation  can  be  interpreted  as  a 
stochastic  differential  equation  with  no  lack  of  rigor. 
Sometimes  we  must  represent  g(u)  by  more  complicated 
functions,  say,  by  exponential  polynomials  correspond- 
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ing  to  a  higher  order,  lineur  HtoehiiHtic  differential  equa¬ 
tion  with  conHtnnt  coefficieiitH. 

Using  thiM  quite*  nda|)tahle  nnwlel  we  have  some 
hope  of  desorihing  pursuit  situations  with  some  degree 
of  realism.  Therefore,  we  shall  examine  this  moelel  more 
carefully  than  the  previous  ones.  First  some  simple  re¬ 
marks.  The  velocity  components  of  the  stochastic  vector 
^(0=  ^a(0]  art’  given  by 

ar,(0  V  sin  9?,, 
ijff)  =  V  cos  (ft, 

the  length  of  the  vector  being  ||  x(f )  ||  =  v.  The  accelera¬ 
tions  are 

Xi(0-t;cos9?,9P„  1 

-  V  sin  ftff  j 

In  the  case  g(ii)  -  e  ““  the  accelerations  do  not  exist, 
but  they  do  generally  if  g(ii)  is  a  higher  order  expo¬ 
nential  polynomial.  In  that  case,  gf(0)  =  0,  and  we  get 

£;|1  m  II*  -=  r*  E  [V-  (f  )]*  -  2^  J  *  A*  1 0{X)  I*  dX, 

where  we  have  introduced  the  Fourier  transform 

/•oo 

0(A)  =  J  e''‘^g{u)du. 

It  is  easy  to  compute  the  expected  future  motion. 
Since  and  hence  9?,  have  symmetric  distributions,  it 
follows  that  E  sin  (p^  =  0.  Further, 


This  means  that  the  exp«‘cte(l  motion  is  uniform  in  the 
direction  of  the  average  motion,  i.e.,  the  axis,  and 
its  sjK*ed  is  proportional  to  e.  ll  has  boon  reduced  by 
the  factor  of  projH)rtioi!ality 


exp 


u)]  du. 


In  a  similar  way,  one  can  determine  thi  covariance 
matrix  of  the  vector  (sin  (p^,  00s  9?^) 


We  have 


^11  ^'12 

Cji 


r„-E8in*9’,  1E|2  e 


1  exp 


^00 

Jo 


and 


=  E  cos*  (fp  -  [E  cos  (^^1*  -  i  E  [2  i  +  c  *'^/»] 


-  [E  cos  9^;,]*  =  2  |1  +exp  I  y[2^(u)]duj 


^  2 
—  exp*  r  y[j7(u)]du. 


|l+cxpj^  y[2^(u)]du| 


Finally,  it  is  clear,  because  of  the  symmetry  of  the 
distribution  of  9?a,  that  the  second  order  mixed  mo¬ 
ment  C12  =  Cji  =  0. 

Let  us  calculate  the  covariance  function  for  sin  (p,. 
say,  for  A  >0. 


E  cos  97,=  i  Ec'»’'+  J  Ee"'^' 


^E  exp 
+  JE  exp 


j  (7(<  -  w)d^(«)J 


g{t  -  u)  d^(u) 


J- 


To  compute  these  integrals,  we  use  the  fact  that  the 
increments  d^(u)  are  independent.  The  multiplicative 
property  of  characteristic  functions  gives  us 

Ecos97j=iexp  y[9(t- '’i)]du 
J  -  00 

+  J  exp  I*  y[-  g(t-u)]du 
J  00 

=  exp  f  y{g{t-u)]du 

J  -  CO 


/?,  (h)  =  E  sin  97,  sin  97,  + 

=  -  JE  [(«'’■« -e  ‘’'*)(e'’’*^*-e 


-Jexp 


+  J  exp 


^00 

Jo 

^00 

J  y[g{u)- 

■/: 


)  f  g{h  t  u)]du  exp 


y[gUi)]du 
g{h^  u)]du  exp  /:  y[g{u)]du 


+  |exp  y[g{u)-g{h  \  u)]d 


u  J* 


y[g{u)]du 


poo  pH 

-Jexp  y[^(u)  +  fir(Afu)]dwexp  ylg{u)]dii 
Jo  Jo 

=  |expf  y[g(u)]du  Icxp  I*  y[g{u)  -  g{h  \  u)]du 
Jo  [Jo 


■  exp 


^00 

Jo 


)  +  fif(A  i  u)]du 


Hence, 
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p-  00 

=  exp  Jo  y[g(u)]du. 

In  an  analogous  manner,  one  derives  for  the  covariance 
function  of  cos  97, 

Ex,  (0  =  0, 

f*oo 

^00 

i?<.(A)=  E  cos  97,  cos  (p,^h~  exp*  y[g{u)]  du 

JO 

Ex2(<)  =  vexp  J  y[g(u)]du. 

=  JE[(e'^*  +  c  p  '^•**)] 
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*  *'**/(. 

*  <'*P  I  y(!/(")  '  (/(w  '  h)]du 

JO 
^oc 

Jo 

'I’licsc  cxprcH-sioiis  arc  useful  to  determine,  among  other 
things,  the  disjersion  of  the  future  positions  of  E\ 

E||x{/)  Ee(0|r  E|e,«)  E  j-,  (Of  !  E  [/^(t)  Kx,(t)\- 

V  rt 


Jo  Jo 

21'*^*  [/?^(?y)  1  I{,{u}](t  u)du. 


The  variatjee  j^(/{v)dv  is  HUpjM)sed  to  he  fixed  in 
advance,  and  y  and  g  are  the  functions  descrihed  be¬ 
fore.  In  the  expression  for  li,  we  have  left  out  the 
constant  mean  value  term,  since  this  would  not  effect 
the  value  of  I,  as  a  consequence  of  J*A(u)dw“0. 

The  most  important  case  is  jwrhaps  that  where  the 
guidance  signals  are  normally  distributed.  The  expreo 
sion  then  reduces  to 


c  u  e  00 

7?(u)  =  exp-J  g^{v)dv+  j  g'{v)dv 
Uo  JO 

g(v)g{v\u)i 
Jo 


IiitHKlucin^ 


J%*(e)de 

V  r</(r)dr, 
J  0 


gilt) 


r 


g[v)g(u  f  v)dv, 


4.7.  Linear  Prrdiclorn 

Now  let  us  study  what  happens  when  P  observes  E 
at  equidistant  times  ....  n-1,  n,  and  predicts 
E„ ,  1  with  the  formula 


it  is  ea.sy  to  verify  that  V  is  the  variance  and  q(u)  the 
correlation  function  of  the  stochastic  process  7,.  Thus 

I  ■-  1{q)^  r  h(u)  exp  {  Klo(w)  -  1]}  du. 

J  0 


E:,^-E,  i  (E„  -  E\  .)  2E„-E 


n  1  • 


This  means  that  he  uses  the  vector  analog  of  a  simple- 
prediction  formula  that  wo  have  discussed.  As  men¬ 
tioned  above,  this  is  an  approximation  to  the  usual 
plotting  procedure.  We  can  determine  the  prediction 
error  by  starting  from  the  relation 


r^n  +  1  n  i; 

II  A’  „ ,  1  -  A’ J  ^  1  j|  cos  90,  dt  -  cos  q't  dt 

L  J  n  J  n  1 


-t- 


■  C  n  >  1  en 

sin  q^dt  -  sin  dt  , 
.J  n  J  n  ■  \ 


SO  tiiat,  as  in  the  preceding  section. 


1 


1}  P  —  V* 
i  £jn^\  ^n  +  l 


112. 


The  reader  may  find  it  instructive  to  derive  this  for¬ 
mula  directly,  without  using  the  predictive  representa¬ 
tion  of  the  qi  process. 

The  extremal  problem  may  not  be  easy  to  solve 
completely  by  analvdical  methods.  How'ever,  we  can 
say  something  about  the  solution.  First  we  must  be 
sure  that  the  maximum  can  really  be  attained.  We  can 
write,  using  Bochner’s  theorem  about  positive  definite 
functions, 


e(«) 


cos  ukdF{}.). 


Here,  /’(A)  is  a  distribution  on  the  positive  half-axis. 
The  .set  of  F  function.,  is  not  compact,  so  that  we  do 
not  arrive  directly  at  the  desired  conclusion.  An  addi¬ 
tional  argument  is  needed,  and  we  put 


=  2j.‘'“ 


)  [^c(«)  I  P,(u)]du, 


sup  I{q)  =  I. 

Q 


with  the  same  function  h{u).  We  get  the  extremal 
problem 


w 


here 


=  h(u)  R(v)  du=  max, 
Jo 

R(u)  =  exp  yf^lt;) j  dvj 


xexp  y[g(v)-g(u+v)]dv 


const. 


There  is  a  sequence  pi(w),  QjIu),...,  with  the  corre¬ 
sponding  distribution  functions  F^iX),  F^iX),...,  such 
that  /(p„) -*•/  =  sup /(()).  It  is  always  possible  to  select 
a  subsequence  F„,{X),  F„,(X), ,  converging  to  a  bounded 
non-decreasing  function  (7(A)  for  every  finite  A.  The 
variation  G(  +  00)  -  0(0)  <  1,  but  we  cannot  exclude  the 
inequality  sign  directly.  However, 

e''l{Qn,)-  I"  h(u)  exp  [Fp„,(u)]du=  ^  PC,, 

Jo  ••“O  ^  • 
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w  ith 


If  K  Ih  larm*,  w<!  iiHo  tlic 


t;-  xa)dK,(X). 

Jo 

Since  x(A)  >0,  it  follows  that  no  mass  of  the  F„,(X)  can 
flow  out  toward  f  since  this  would  make  the  C„ 
and  hence  I{Qn,),  smaller  than  necessary.  Here  we  have 
used  the  fact  that  x(A)  decreases  to  zero  when  yl  tends 
to  -t  oo.  Thus,  converges  weakly,  and  0(A)  is  an 

ordinary  distribution  function,  so  that  0(+  oo)  -  0(0)  = 
1,  and  0(A)  realizes  the  maximum  of  I(q).  It  is  tempting 
to  use  convexity  arguments  to  show  that  the  maximum 
is  unique,  but  this  has  not  been  done. 

We  can  characterize  qualitatively  the  distribution 
function  F{X)  that  realizes  the  maximum.  Let  s{F)  be 
the  support  of  F(X).  We  now  use  the  same  sort  of 
variational  argument  ns  before  (p.  15  ff  ).  If  A,,  Aj  are 
two  arbitrary  points  in  ^(F),  and  F,  (A)  has  been  mod¬ 
ified  in  the  neighbourhood  of  A,  and  A2,  we  must  have 


oe  r2 

^(p)”  1  Pr  Q’{u)h(u)du, 

r-0  Jo 

where  p,  is  the  Poisson  probability  {V’/v\)t  and  p*' 
corresponds  to  the  vth  convolution  .  (A).  But  the  re¬ 

lative  concentration  of  the  Poisson  distribution  in¬ 
creases  with  V ,  and  we  can  therefore  exj^'ct  to  get  an 
almost  optimal  solution  l)y  placing  all  the  mass  of  F(X) 
in  the  frequency  Aopt '  V ,  where  Aopt  was  the  value  de¬ 
termined  in  section  4.3;  note,  that  V  is  the  mean  value 
of  the  Poisson  distribution. 

If  V  is  in  the  intermediate  range,  we  must  compute 
the  solution  numerically.  This  is  not  a  task  of  routine 
character  and  presents  considerable  difficulty.  Both  the 
analytical  and  the  numerical  problem  seem  to  deserve 
more  attention. 


1{F)>1(FA 


=  1(F)  f  I J  ^1  “  “  1]} 

-£a(»)co8  A2«exp{P[o(«)-l]}du|  -fo(e). 


Hence, 


A(«)  cos  Au  exp  {  F[p(u)  -  1]}  du 

Jo 


=  C  constant,  all  X^8(F). 


But  the  left  side  is  an  entire  function  of  A.  If  s{F) 
has  an  accumulation  point  in  the  finite  part  of  the  A 
axis,  the  function  on  the  left  must  be  identically  equal 
to  C.  Since  this  is  impossible,  it  follows  that  the  support 
of  F  is  discrete:  the  optimum  spectral  distribution  func¬ 
tion  has  all  its  ma.ss  in  a  finite  or  denumerable  set  of 

frequencies  ApAj .  The  corresponding  point  masses 

will  be  denoted  by  F^,  F^ . 1-  The  correlation 

function  has  the  form 


4.8.  Non-linear  Predictors 

In  this  discussion  we  have  assumed,  so  far,  that  the 
method  of  prediction  had  been  fixed  iu  advance.  Actu¬ 
ally,  we  used  a  highly  specialized  linear  predictor  of 
the  first  order.  Now  we  turn  the  problem  around  and 
look  for  the  Ix'st  predictor  (linear  or  not)  when  he 
stochastic  properties  of  the  evasion  are  given.  Sur¬ 
prisingly  in  this  case  the  non-linear  prediction  problem 
can  be  solved. 

W’ith  the  same  notations  as  before,  we  assume  that 
the  vector  process  x(t)  has  been  observed  in  the  past, 
-  cxD  <  <  c:  0.  We  want  to  determine  the  best  predictor 
x'(h)  in  the  sense  of  the  least  squares  criterion  of  the 
future  value  x{h),  A  >0.  Using  our  observations,  we  can 
reconstruct  (j?,  and  for  t  <  0.  The  optimal  predictor, 
the  regression,  is  always  the  conditional  expected  value 
of  the  future  value  given  the  past  observations.  Using 
the  notation  Eq  for  the  conditional  expected  value 
operator  defined  by 

Eo2=E{2|x,  observed  for  .s<0}. 


e(u)  =  2  f^os  A,  u. 

P 

It  may  be  noted  that  if  the  A  are  infinitely  many,  so 
that  A  =  +  00  is  an  accumulation  point,  it  follows  from 
the  Riemann-Lebesguc  lemma  that  C  =  0. 

If  V  is  small,  we  have  approximately 

/(g)  s  V  f  h(u)Q(u)du. 

J  0 

This  leads  to  the  same  maximum  problem  that  we 
solved  in  a  previous  place.  Expanding  the  exponential 
function  in  series,  we  get  an  expression  for  the  error. 


we  get 


fh  eh 

Xi(h)^vEo  ain  (pi(U=v\  Eq  sin  9?,  df, 

Jo  Jo 

eh  eh 

X*  (h)  ^  vEq  I  cos  (pi  dt  --=  V  Eo  cos  (p^  dt. 

Jo  Jo 

But, 

Eoe‘^’’'  =  Eoexpt2  |  |  g(t-u)d^(u)+  j  g(t~u)d^(u) 

L  J  -OO  Jo 

=  exp  j^t2  j*  g(t  -  u)  d^(u)  E  exp  g(t  -  u)  d^(u)j 
=  exp|i2j  g(t-u)d^{u)  exp  y[2  (/(f  -  m)]  dwj  . 
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Eo  Hin  qn,  “•  y,  Hin  q*, 

Eq  COH  y*  t-OH  9*, 

where  we  have  introduced 

y,-exp  f  y\(j(l-u)]du 
J  (i 

and  the  optimal  linear  predictor  99*  of  the  courae  angle  9, 


Here  we  have 


V'.  ■  rt  ^  f  !/(•«- --  f  g(t-u)d^(u) 

OC  «/  OC 

=  J  [</('- w)-fit(f-w)]d^(u)  -  J  g[t-u)d^{u). 

The  terma  in  the  last  expression  are  indejKJiident,  and 
their  variances  can  thus  Ik*  mlded,  giving  the  variance 
of  (f,  -  (f,  as 


99?  -  Eo(ft  =  J 


g(t-u)dS{u). 


var  (99 


[9(5  -  u)  -  g(t  -  u)]^du  + 


f,* 


(v)  dv. 


The  function  y,  tells  us  with  what  8p<“ed  the  predicted 
point  z*{t)  moves  when  t  varies. 

The  minimum  prediction  error  can  he  calculated  in 
the  same  way  that  we  got  the  covariances.  The  cal¬ 
culations  are  a  bit  cumbersome,  and  it  will  be  enough 
to  show  how  it  is  done  for  the  normal  distributions. 
We  get 

^‘,e||x(A)-x*(A)||*-  ^;,e[x.(/o  xr(A)]“ 

4  E[xj(A)-xJ(A)]* 

n"  . 

E(ain  99,  -  y,  sin  99*)  (sin  99,  -  y^  sin  (p*)ds  dt 

) 

ah 

E(cos  99,  -  y,  cos  99*)  (cos  99,  -  y,  cos  (p*)dsdi 

) 

nh 

E  cos  (91,  -  (ft)  ds  dt 

) 

ns 

y,  y,  E  cos  (99*  —  99* )  ds  dt 

} 

-  I*  f  y,  E  cos  (<p*  -<pt)dsdt 

J  0  J  0 

—  I  yfE{costp,~  <p*)dsdt. 

J  0  J  0 

Now  we  use  the  normality.  If  x  is  normally  distrib¬ 
uted  =  N(0,  a),  we  have  the  elementary  relation 

E  cos  x  =  J  E(e'* +  €'**)  =  c" 

Hence,  in  our  case, 

\E||x(/i)-x*fA)||*=  I*  I*  K{s,t)dsdt, 

^  Jo  Jo 

where  the  symmetric  integral  kernel  K{s,t)  is  given  for 
s  %  t  by  the  expression 

K(s,  t)  =  E  cos  (99,  -  99,)  i  y.y,  E  cos  (9*  -  9’,*) 

-  y,  E  cos  ((f*  -  99,)  -  y,  E  cos  (99,  -  99,*). 


The  first  term  of  K(s,  t)  is  therefore 


E  cos  (9),  9,)  expj-'^J  [9(a- u)-9(t-u)]*du| 

The  remaining  terras  are  computed  analogously,  and 
we  get 


K(8,t)  -^  exp 


[g(t  -  u)  -  g(s  -  u)]*  du 


exp(-^j*^  g*(u)duj 

p(~^  j  ■■ 


u)]*duj 


xexp(-^  J  ^*(t-u)(fuj 

xexp(-^ 

Pxp(~^J  [g(t  -  u)  -  g(s  -  u)]*  du 


exp  y 
X  exp 


j*  g^(t-u)duj 


xi‘xp(^-.,  J  ?*(.<* 


X  exp  j 

(-ij 

g^(s-  M)du| 
0  / 

X  exp  1 

1 

1  2. 

1*  g*{l-u)du\ 
0  / 

The  last  three  terms  in  this  expression  are  equal,  one 
of  them  with  positive  sign  and  the  other  two  with 
negative.  Their  sura  is  therefore  equal  to  one  of  them 
w'ith  negative  sign. 
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The  first  term  cun  lx*  written 


‘'*P1  “  o  I  w)  (hi  f  I  ,/(/,  -  ii)du 

^  LJ  00  J  oo 

+  f  5r*(v)efe]+f  g(t  -  u)  g(s  -  u)  du 

Jo  J  J  OC 


=  exp 


”  2  J,  '  J 


+  1*  (/*(t’)rfe]+f  g(t- u)g(s-u)du 

Jo  J  J  ~oo 

=  exp|-  j  j  g(t  -  u)  g(ii  -  u)  du 

[Jo  J  oo 

The  other  term  is 


exp 


^  J*  g*(s~u)du 

+  f  g^(t-u)dii^  f  ^*(5-u)du 

Jo  Jo 

+  j'  g(t  w)  £r(«- w)</.v| 

=  -exp|-j  fir*  (e)  del  j  g(t  -  u)  (j{s  ■- u)du 
[  Jo  Jo® 

Introducing  for  the  variance  the  notation 

F  =  f  g^{x)  dx, 

Jo 


we  get 


K(8,t)  -e*’'  |cxp  J 

r 

g[t-  u)g(a-u)  du 

0 

-expj 

g(t  -  u)  g(s  -  u)  du 

*0 

=  exp  -  F  -i- 

g(t  -  u)  g(s  -  u)du 

L  J 

■  0® 

X  j^exp 

IJ  g{t  -  u)  y(s  -  u)  du 

For  this  prohlein  there  is  an  attractive  method  of  solu¬ 
tion,  and  we  shall  discuss  this  possibility.  We  have 


nh 

K,(s, 

) 


t)  ds  dt 


h  (•ti  rmlno.l) 


ran 

) 


g{t  -  u)  g(s  -  u)  du  ds  dt. 


The  region  of  integration  is  bounded  by  the  five  planes 


u,  8  --  h, 
t  -  u,  t  =  h, 
u  0. 


We  introduce  s  u  --  x  and  t  -  y.  The  Jacobian  is 
1,  and  the  boundaries  are  transformed  to 

a-  =  0,  X  -  h  -  u, 
y  0,  y  -h  -  u, 
u  -■  0. 


Thus,  u  lies  between  zero  and  H(x,y)  min  (A  r, 
h~y),  whereas  x  and  y  both  lie  between  0  and  h, 
giving 

A',-  dug(x)g(y)dxdy 

Jo  Jo  Jo 

nn 

H(x,y,)g(x)  g(y)dxdy. 

) 

Let  A  be  the  largest  eigenvalue  of  the  integral  equation 

Ay(x)=  I*  H(x,y)y(y)dy, 

Jo 

and  y(x)  a  corresponding  eigenfunction  normalized  so  that 

rh 

J  y*(x)  dx=  V. 


We  now  turn  to  the  extremal  problem  of  determining 
the  maximum  of 

A-^  r  =  E||x(A)-x*(A)||* 

Jo  Jo  ^ 

when  the  value  of  V  is  given.  The  kernel  K  depends 
in  a  non-linear  way  on  the  unknown  function  fir(<).  It 
may  be  of  interest  to  observe  that  if  the  eva.sive 
maneuvers  are  not  too  large,  so  that  the  linear  ap¬ 
proximation  is  applicable,  we  get  the  same  problem, 
but  with  the  kernel 

^mlnd,  O 

Ki{s,t)~~  <j(l  -  -  u)du. 

Jo 


Under  the  side  condition  jo‘g^(t)dt  V,  we  h  ve 

K^(g)'^XV=  Ki(y) 

for  an  arbitrary  fif(<)  of  predictive  type. 

On  the  other  hand,  if  y(x)  is  the  eigenfunction  men¬ 
tioned  above  (whether  it  is  of  predictive  type  or  not), 
the  prediction  error  is  at  least  equal  to  ATj  (y)  according 
to  traditional  prediction  theory.  The  optimal  evasive 
tactics  is  then  realized  by  the  function  y{x).  It  is  easy 
to  calculate  y{x).  Indeed,  the  integral  equation  can  Ik 
written 

Ay(x)=(A-x)f  y(y)di/+  f  (h-y)y(y)dy, 

Jo  J I 
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wliicli  aft<*r  two  diffi'reiitiatioim  hoconu's 


HO  that 


^y’(r]  t  y(x)  ^  (», 
y{x)  Ae'’“  t  Ik 


It  in  natural  to  ask  if  thia  game  Hituation  iw  definite. 
Let  UH  investigate  the  problem  in  slightly  more  general 
terms.  Let  a{t)  be  a  given  continuous  function  defined 
on  the  interval  (0,  h)  and  form  the  stochastic  variable 


witli  X*  1  A.  This  function  satisfies  the  integral  equa¬ 
tion  only  if  cos  xh  0,  i.e.,  the  eigenvalues  are 


’^""•±'■±2 . 


A^  --  f  a(t)(ptdt. 
Jo 


and  honce, 


3  ,  4h* 

A  =  max  Ale  =  , 

k  n 


C  cos  ^  ,  X,  0<  x<  h, 

yW-  2*  ' 

0  otherwise. 


The  constant  C  should  be  chosen  so  that  ||y||*  equals 
the  given  value  of  V.  The  corresponding  covariance 
function  is  given  by 

r{t)  -  f  ff{t  -  u)g(  -  u)  du  -  C*  (*  cos 

J  CO  J  A  +  t  *■/! 

71  C*  '  71 

X  (t- u,  COS  ^^udu  =  Y 

for  i)<t<h.  It  is  represented  graphically  for  C*~  2, 
h  1  in  Fig.  17. 


After  having  ob.served  the  stochastic  process  9?,  for 
we  want  to  predict  the  value  of  A(f’  with  the 
best  linear  predictor  pg .  Consider  the  game  w  ith  the 
payoff  function  R{q\  p)  ^Ap  P9)|p  E[A(p  P95]*, 
where  is  a  stationary  process  with  finite  variance, 
say,  equal  to  1. 

In  the  problem  that  we  have  just  met  we  hada(<)  =  l, 
and  we  had  determined  max^  min^  p),  which  turned 
out  to  be  the  largest  eigenvalue  of  a  certain  integral 
equation.  In  the  pre.sent  case  we  should  find  the  largest 
eigenvalue  of  the  equation 


lH-r,y)  y(y)dy, 


with  the  symmetric  kernel 


Cmlni/i  i.h  1/) 

r,  y)"=  I  a{x  i  u)  a(y  +  u)  du. 

J  0 


It  is  convenient  to  first  approximate  a{t)  by  a  step 
function 


a„(<)  =  a^=a  ^ 


V  V  +  1 

if  -h^t< —  h,  v  =  0, 1 . n-1. 

n  n 


It  is  clear  that 


0  0.2  0.4  0.6  08  1.0 

f 

Fig.  17.  The  covariance  function  r(<). 

The  optimal  evasive  tactics  against  the  optimal  predic¬ 
tion  is  then  the  one  generated  by  a  normal  process 
with  the  given  covariance  function. 


IJ  aniOq'tdt  Hydl  •  J  |a(/)  -  a„(0|  df, 

so  that,  if  n  is  large  enough,  we  commit  only  a  small 
error  when  we  replace  Atp  hy 

rh  J  n 

a„(t)(ptdt  1 
Jo  •'-0 

^  O'  1  I  )^  .  n 

where  n  I  9(  dt. 

J  rh  ri 


Note  that  forms  a  stat'^nary  process  with  a  var¬ 
iance  at  most  (‘qual  to  1 ,  since 


/’[(»■  • 
J  n] 


((»’ »  1 )  n  1 


(fi  dt  h  (f(  fi. 
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If  wf  use  only  the  obHer%e(i  viiIueH  of  f/,,  iiiHteivd  of 
f,,  wc  get  at  least  as  laige  a  value  for  iniiip  inax^ 
B{(f,p).  On  the  other  hatvl,  if  {y-J  runs  through  all 
the  stationary  processes  with  a  variance  at  most  equal 
to  1,  we  get  again  to  the  discrete  problem.  But  this 
value  can  be  expressed  in  another  way.  Using  Cranu^r’s 
spectral  representation,  we  can  write 


e‘"^dZ(X), 


with  II  A2(/l)  II*  =  AF(A)  =  increment  of  the  spectral  dis¬ 
tribution  function  corresponding  to  the  process 
Further, 


miiip  inaxy  - /jy  ||  ■..  max^  miiip  ||/lf/i  py||, 

and  only  ecjuality  is  possible.  Hence,  the  game  is  de¬ 
finite,  and  its  value  equals  the  largest  eigenvalue  of 
the  integral  equation. 


4.9.  The  Case  with  Constant  Velocity  in  One  Direction 

We  now  consider  another,  but  closely  related,  pursuit 
problem.  Tho  evader  E  moves  in  a  plane  with  a  mo¬ 
tion  whose  X  component  can  be  completely  or  at  least 
approximately  described  as  uniform  motion  (Fig.  18). 


Variance  of  y)„ 


dF(X)-  h. 


\  ' 


We  also  have 


2  n  - 1  1 

Wo  30 


=j: 


[a(;)-  c(X)]dZ(X), 


where 


c(A)=-  2  c,.e"'\ 


and  the  series  ^Cycp^  is  assumed  to  converge  in  the 
mean.  But  then, 

-  2  a„y)„-  2  <'*-y>J  =  f  \a(X)-c(X)\^dF(X), 

^  0  00  II  J  n 


so  that 


max  ||/l„y)-py)||*=  max  |a(A)  -  c(A)|*. 

w  X 


Now  we  can  apply  a  theorem  for  Toeplitz  forms  (see 
Notes)  and  see  that 

min  max  || /!„  y;  -  py  ||* 

p  <c 

is  at  most  equal  to  the  largest  eigenvalue  of  the  sym¬ 
metric  n  X  n  matrix  with  the  elements 


+  a(A)u^l  ” ^  ' 

for  p<q;  p,  0,  1,  ...,  h  -  1.  For  large  n,  this  eigen¬ 
value  is  approximately  equal  to  the  largest  eigenvalue 
of  the  integral  equation  we  had  before.  Hence 


Fijf.  IH  Motion  with  constant  component  itt  the  x  direction. 

We  denote  the  acceleration  in  the  y  direction  by  (p(t)  - 
y{t),  to  resemble  the  notation  used  above.  After  h  units 
of  time,  E  has  travelled  the  distance 

|*  {h-t)(p,dt 

Jo 

in  the  y-direction.  Identify  this  expression  with  our 
A(p  that  shall  be  predicted,  using  the  knowledge  of  the 
past  trajectory  of  E.  Put  A  =  1  for  simplicity.  Since 
now’  a(t)  -I- 1,  we  shall  determine  tho  largest  eigen¬ 
value  and  the  corresponding  eigenfunction  y{t)  to  the 
integral  equation 

Xy(t)-=  j:  K (t,  s)  y(s)  ds 

with  K{t,s)=^  f  (I  —  u  —  t)  {\ -  u  -  s)  du 

J  0 

for  s<  t\  K(s,t)  =  K(t,s).  With  similar  but  slightly  more 
complicated  calculations  as  before,  when  a(f)  =  l,  we  get 

y(0  =  Oi  (cos  xt  t  cos  hxt)  +  6*2  (sin  xt  +  sin  hxt), 

where  X  =  x  *.  The  constant  x  shall  be  the  smallest 
positive  root  of  the  equation 

cos  X  •  cos  hx=  —  1 . 

The  coefficients  and  Cj  shall  be  determined  so  that 
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yd)  0. 

y^{t)dl  given  variance. 

Vo 

We  get  approximately  «>1.88,  so  that  the  value  of 
the  game  is  0.08.  The  optimal  evasion  is  obtained 
by  feeding  random  noise  f(<)  into  a  linear  filter  with 
the  response  function  k(t);  the  output  of  the  filter  is 
the  acceleration  of  E  in  the  y  direction. 


decide  what  form  the  function  p(6)  should  have.  For 
simplicity,  we  assume  that  p(b)  is  proportional  to 


Other  choices  of  p{b)  dealt  with  individually. 

The  vector  b  ^  (^>1,62)  has  a  normal  distribution  whose 
second  order  moments 


4.10.  The  Ccute  mth  Two  Variable  Velocity  Components  ^11 

U‘t  us  investigate  the  following  type  of  evasion,  ^2x2  matrix  M 

The  evader  E  moves  in  a  plane,  the  velocity  vector 

t(<)  =  [xj  (f),  Xj(<)]  forming  a  normal,  stationary  stochas-  f 

tic  process  with  the  spectral  density  matrix  "  j 


m„--Eb^b,,  i,j=l,2,  ..., 


m,,  m, 


/ii(^)  I 

fnU)  /.2  a)  r 


w’here  /j,{A)  and  /22(A)  are  the  8j)ectral  densities  of  the 
coordinates  x,(()  and  X2(/),  respectively,  and  where 
/i2(^)  /2i(^)  thP  (complex  valued)  cross-spectral  den¬ 

sity  between  x,  (f)  and  XjlO-  The  kinematic  restrictions 
are  given  as 

f  K(A)/i,(A)  t  a,(X)U,a)]dk<.A. 

J  -  00 


We  can  write  down  the  expression  for  the  probability 
of  hit 


Ep(6) 


2  71  l^det  M 

^90  r  OC 

J  J 

J  00  «/  3* 


-b'M 


'6|  dbi  dftj 


2;i  1  det  if 


rj' 


exp{-J6'iV  ^b}dbidb^, 


be  evaluated  as 


This  form  is  general  enough  to  describe  many  impor-  /  /  \-i 

tant  restrictions.  Perhaps  the  most  important  case  is  "’here  if*=l^  +  if  I  . 

the  symmetric  one,  o,(A)  =  02(A)  o(A),  where  both  co¬ 
ordinates  are  treated  in  the  same  way.  This  would,  e.g.,  jg  integral  of  well-known  form,  and  it  can 

be  the  ca.se  when  the  restriction  is  on  the  mean  square  jjg  evaluated  as 
value  of  the  acceleration  or  velocity:  o(A)  =  X*  in  the 

first  cae-j,  and  a(A)  =  A*  in  the  second.  i/det  /  C 

The  first  order  linear  predictor  will  be  used;  Ep(f<)  =  6  j/  -  C  1  det  iVif  -  _  _  • 


Ep(f>)  =  C 


Met  N 
det  if 


Cl'detiVif  '  = 


E^  =  E^^  Ax(0). 

To  study  the  miss  distance  b  belonging  to  prediction 
h  steps  ahead,  we  write 

6=J  x(t}dt- hx(0). 

The  earlier  discussion  was  built  on  the  criterion  Eb^. 
This  will  often  be  natural,  at  least  as  a  first  attempt. 
Sometimes  it  will  bo  nece.ssary  to  be  more  realistic  and 
introduce  the  probability  of  hit,  p,  as  a  function  of  the 
mi.ss  distance,  p  =  p(6).  This  is  clear,  especially  when 
w'e  have  to  take  into  account  the  ballistic  dispersion. 
Note,  that  the  following  reasoning  can  be  modified 
without  too  much  trouble  it  we  want  to  include  the 
superimposed  error  of  observation.  Then  we  observe, 
not  x(t),  but  x(f)-f-£(l)  for  f^^O,  where  e(t)  is  the  error 
vector.  Pure  speculations  will  not  help  us  much  to 


^dei  ^7  +  ^  if  j 


It  is  in  E's  interest  to  choose  his  tactics  so  that  E  p(b) 
is  small,  i.e.,  det  {a'I  +  M)  is  as  large  as  possible  under 
the  given  side  conditions.  To  carry  out  this,  we  ob¬ 
serve  that,  putting 


,  c*'’’*  1  ,  * 

7(A)  -  -  - h  , 


we  get 

7(A)/u(A)rfA, 

J  00 

£^2"=  I*  7(A) /22(A)  dA, 

J  00 

E6i6,=  f  7(^)/ii(^)‘^-^- 

J  -  00 

We  should  then  maximize  the  determinant 
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dot (d*/  I  3/) 


^oj  ir  c  ^  1  r  ^ 

^  7/11^^  ~'  7/12^^ 

Joo  JL  J»  JJoo 


This  is  an  cltMiuMitary  inaximuin  problem  with  two 
2  variables  C\  and  C\,  and  with  side  conditions  as  above. 


The  kinematic  restrictions  have  been  imjMJscd  upon 
/,j(A)  and  /12(A).  In  whatever  way  these  functions  have 
l)een  chosen,  we  can  maximize  the  determinant  by 
putting  /12(A)-  -0;  this  is  admissible,  since  it  does  not 

violate  the  inequality  ]/, 2(A)!  <  l/n (A) /22(A)'  The  phys¬ 
ical  interpretation  of  this  is  that  the  evasion  can  be 
governed  by  two  uncorrelated  (incoherent)  velocity  com¬ 
ponents,  Exi(<)xj(t)  0. 

Let  us  go  ahead  and  determine  /,,(A)  and  /22(A)  We 
have 

3f  -  det  (0*/  I  M)  o*  I  o"  j  qfdX 

J  00 

^00  I*  uo 

'  7/11'^A  7/22^A, 

J  00  J  00 

where  we  have  put  /],  (  /22  /.  If  and  are  the 

supports  for  /,,  and  /22.  respectively,  the  usual  varia¬ 
tional  argument  gives  the  following.  Vary  the  value  of 
/i(A)  at  the  frequency  AiC^,,  and  at  the  same  time 
the  value  of  /2(A)  at  A^G^V  so  that  the  equatioti 


I  / 1  ^  I  ^3 

J  Si  Js, 


f^dX  A 


still  holds.  A  simple  calculation  gives  us 


qU) 
Cl  (A) 
7('l) 

02(A) 


=  C,  for  all  A  € 


r,  =C2  for  all  AG.S'2, 


together  with  the  relation 

Here  we  have  defined 

/• 

A^-=  j  ai  /|i  dX, 

A  2  ^ 

A,  !  A2  A, 

and  the  constants  C,  and  ('2  must  In?  chosen  among 
the  values  that  are  taken  by  the  functions  7(A) 'o,  (A) 
and  7(A)  OjfA),  respectively.  The  expression  to  be  maxi¬ 
mized  is  then 

A/  -(T*j7/„dA  •  (T*j'7/22dA  + j7/„dAj7/2,dA 

(T*  C,  A  J  +  c*  C2  /1 2  t  ^  1 3 1 3  J. 


For  given  functions  o,  (A),  02(A),  and  7(A),  we  can  deter¬ 
mine  the  maximum  directly. 

VV'e  remark  that,  in  order  that  the  previous  reasoning 
shall  be  complete,  it  is  necessary  to  verify  that  the 
supremum  of  M  is  attained  so  that  an  optimal  solution 
really  exists.  This  is  not  difficult.  First,  wo  must  op¬ 
erate  with  dF,i(X)  instead  of  with  /,,(A)dA.  Further,  we 
shall  demand  that  limi_», »  |o,(A)|  I  0°.  If  one  looks 
into  this,  one  sees  that  this  is  really  a  compactness 
condition  for  the  set  of  admissible  spectral  distribution 
functions.  Using  this  compactness,  we  can  complete  the 
proof  of  the  existence  of  an  optimal  solution. 

4.11.  Thrrr-dimrit.si(>nal  Pursuit 

By  now  we  should  hav(>  .some  idea  of  how  a  two- 
dimensional  pursuit  problem  can  be  dealt  with.  When 
we  turn  to  three  dimensions,  we  do  not  expect  to  meet 
any  new  fundamental  difficulty,  but  of  course  higher 
complexity  and  more  cumbersome  calculations.  Lot  us 
take  a  brief  look  at  a  simple  three-dimensional  situation. 


Fig.  19.  The  angles  «  and  (p. 

The  evader  E  moves  in  space  with  the  constant  sjK'cd 
(■  in  a  direction  described  by  the  unit  vector  e(t)  at 
time  t.  Introduce  the  angles  a  and  7?  as  in  Fig.  19, 
0  cia<  .T,  0  ■^7?<  271.  Let  a  ^  0  be  the  direction  in  which 
E  wishes  ’o  travel.  Then  it  is  natural  to  ask,  just  as 
before,  that  cos  a  be  kept  as  close  as  |H)ssible  to  1, 
at  least  on  the  average.  The  expression  vE  cos  a  is 
the  expected  velocity  component  in  the  direction  a  0 
and  should  be  made  as  large  as  possible,  i.e.,  close  to  e. 
When  t  varies  we  shall  let  Ef  form  a  polygon  in  space, 
or,  in  other  words,  e(t)  shall  be  stepwise  constant,  so  that 

c(<)  =  e,, 

...<«_!<  fo<<i<  ■  J 
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T  h<*  time  points  t,  shall  he  chosen  so  as  to  form  a 
I'oisson  process  with  intensity  X,  so  that  on  the  average 
we  get  X  changes  of  direction  per  time  unit.  The  stochas¬ 
tic  vectors  e„  shall  be  independent  and  have  the  same 
probability  distribution  over  the  surface  of  the  unit 
sphere.  We  then  get  trajectories  looking  something  like 
Fig.  20,  where  the  angles  between  the  two  consec¬ 
utive  course  vectors  and  e,,i  are  of  importance  in 
th(‘  following.  This  mathematical  model  for  the  velocity 
vector  V  e(l)  is  a  stationary  stochastic  process  with  the 
mean  value  vector 


Fig.  20.  Motion  with  course  changing  at  random  intervals. 


after  one  time  unit  is  theti  approximated  simply  by 
uffO).  The  mean  square  prediction  error  a*  is  given  by 
the  expression 


(Ti 


E|  |'[e(0-e(0)]d< 


But, 


E  (e(0  “  Tn)ds(lt 


E  (e{t)  -  tn,  e(0)  -  m)dt 

■I  E||e(())  f  [  r(s  t)dsdt 

J  0  J  0 


r{t)(lt  I  r(0) 


''[£// . . 


<U  I  1 


It  is  in  E'h  interest  to  make  C-^EUe  m||*  as  large 
as  possible.  If  w(*  demand  that  the  side  condition 
m,  E  cos  a  >  6  be  satisfied,  and  since 


C  EV(e,  m,)*-EVc;  V  ^  1  -  ||  m||* 
1  1  1 

-  I  ,^2 

'*  1  7Tli  t 


We  have  represented  it  in  a  rectangular  coordinate 
system  with  origin  in  E,,  and  with  the  first  coordinate 
axis  in  the  direction  a=^  0.  We  introduce  the  covariance 
function 

r(s  -  f)  ^  E  [e(s)  -  m,  e(l)  -  tn], 

where  (x,  ij)  means  the  inner  product  of  the  two  vec¬ 
tors  X  and  y.  We  then  get 

r{h)  =  7V{no  event  in  an  interval  of  length  A}  •  £  ||e,  -  m||’ 
f  /*r(at  least  one  event  in  an  interval  of  length  h} 

•  E  (c,  -  m,  e,-  m). 

The  second  mathematical  expectation  vanishes  because 
of  the  independence  of  e,  and  Cj,  so  that 

r(h)  =  e  ^'‘•E||e, 

Perhaps  this  model  is  too  simple  to  describe  real  evasive 
maneuvers.  However,  it  can  be  modified  to  a  more 
flexible  model. 

Let  us  first  consider  the  case  where  P  uses  a  first 
order  linear  predictor.  The  true  position. 


it  follows  that  maximum  is  attained  by  putting  m,= 
m,  =  0.  The  notation  «,,,  m,,  stands  for  the  coordinates 
of  the  unit  vector  e  and  the  mean  value  vector  m, 
respectively.  Intuitively,  this  is  quite  clear:  the  mean 
direction  should  be  chosen  as  a  =  0,  because  every  sys¬ 
tematic  deviation  from  this  direction  makes  m,  smaller 
without  causing  trouble  for  the  predictor. 

The  previous  reasoning  is  not  limited  to  predictors 
of  the  first  order.  Instead,  let  P  choose  the  best  pre¬ 
dictor  (in  the  sense  of  the  least  squares  criterion),  linear 
or  not.  One  knows  that  this  is  given  as  a  regrest'on 
expression,  or,  in  other  words,  as  a  conditional  ex¬ 
pectation.  The  conditional  expectation  of  e(t)  when 
e(«),s<0,  is  know'n  is  given  by 

r*{<)  --  c((l)  Pr{no  change  of  the  course  during  (0,0} 

I  m  Pr{at  least  one  change) 

=  e(0)e  I  m(l 


The  smallest  possible  prediction  error  is  then 


e(t)dt 


f 


I 

e*(t)dt 


[t  (t)  -m]dt- 


it 


[e(0)  -  m]dt 


It 
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r(s  -  l)dsdt 


-  2v* 


C 

X'  Jo 


r(t)  dt^v* 


r(0). 


This  expression  is  proportional  to  C  and  is  maximized, 
just  as  before,  by  choosing  m,  mj=0. 

In  order  to  compare  the  result  of  the  first  order  and 
the  general  predictor,  we  should  compare  the  two  ex¬ 


pressions 


4.12.  Pumuit  Prof)Ums  of  a  Mon  General  Type 

We  have  mentioned  in  section  2.1  that  one  can  mc«  t 
pursuit  problems  where  it  is  natural  to  introduce  more 
than  three  degrees  of  freedom.  This  is  when  it  is  nec¬ 
essary  to  take  into  account  the  geometrical  shape  of  E 
or  P,  and  when  it  is  not  allowed  to  approximate  them 
as  points.  This  will  be  necessary  if  the  form  of  the 
target  is  oblong,  and  if  the  effect  of  the  weapons  (or 
reconnaissance)  is  proportional  to  the  area  shown  by 
the  target. 

Another  situation  where  the  directional  effect  is  so 
strong  that  is  should  not  be  neglected  is  when  the 
target  is  a  heat  source  and  infrared  techniques  are  used. 


P. 


Fig.  21.  Motion  from  to  p,  minimizing  tome  effect  from  •  fixed 
point  q. 

We  shall  indicate  how  problems  of  this  type  can  be 
studied.  Let  us  start  with  a  simple  situation  of  a  cer¬ 
tain  interest:  then  evader  E  tries  to  move  from  one 
point,  po,  to  another,  p,,  see  Fig.  21.  Certain  restric¬ 
tions  are  given  for  the  motions,  e.g.  the  speed  v  may 
be  given.  Other  restrictions  will  be  discussed  later  on. 
During  his  motion,  E  is  exposed  to  the  effect  of  some 
activity,  say,  bombardment  from  a  point  q.  Assume 
that  this  effect  is  additive;  if  it  is  a  bombardment  we 


may  think  of  tho  expected  number  of  hits.  We  shall 
assume  the  effect  to  be  proportional  to  three  factors, 
(1)  some  function  p(r)  of  tho  distance  to  q,  (2)  the 
time  of  the  activity,  and  (3)  the  area  of  tho  target 
shown  in  the  direction  of  q.  The  third  factor,  y,  is  usu¬ 
ally  a  function  of  the  angle  6,  y-y{B).  Wo  are  thinking 
of  £  as  a  rectangle  with  length  L  and  width  B.  We 
then  get  y  =  y(0)  •=  Lisin  0|  f  if  | cos  0|.  The  total  effect  is 

«(>')“!  y(®)  P(r]dt, 

where  tho  line  integral  shall  be  extended  over  some 
trajectory  y  joining  the  points  po  and  p,. 

Let  us  rewrite  the  expression  using  tho  arc  element  ds: 

Hr)  £p(r)[Lr|^j+«|*|]rf« 

V  J  y 

The  admissible  trajectories  y  form  a  set,  T.  If  P  is 
such  that  r  and  q>  are  non -decreasing  functions  of  s, 
wc  can  leave  out  the  absolute  value  signs  and  get  the 
simpler  expression 

«(y)  =  j*  1^^  p(r)rd<jp-l-^p(r)<fr 

The  integrand  is  usually  not  a  total  differential,  since 
then  e{y)  would  be  independent  of  the  path  y.  We  can 
make  it  into  a  total  differential  through  multiplication 
by  a  function  of  r  and  q).  In  other  words,  w'c  can  find 
an  integrating  factor  F=F(r,q)),  such  that 

£j  ax 

-  p{r)rdq>+  p(r)dr=  dyi, 

V  V  r 

where  dxp  =  a(r.  cp)  dq>  +  b(r,  q)  dr 


is  the  total  differential  of  a  function  y>=  y>(r,q>).  To 
find  the  integrating  factor,  we  should  have 

F((p,r)  [Lp(r)rd<p  +  5p(r)  dr]  ^  total  differential, 

which  requires  that 

Lp(r)  +  FL  I  [p(r)  r]  =  Bp(r). 

dr  dr  dq> 

We  get  the  linear  first  order  partial  differential  equation 
dF  dF 

Bp{r)  -Lp(r)r^--L[p(r)r]’F. 

dq>  dr 

The  characteristic  system  of  this  equation  is 

dtp  dr  dF 

Bp{r)  Lp(r)r  L[p{r)r]' F’ 
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with  the  soliitionH 


L 

rexp^9)“(7,, 
Fp(r)r‘’Ct. 

Hence,  with  a  wcllbehaved  function  0, 

Fp{r)r  -  <I)  exp  ^  . 

We  mi^ht  chtKJHe  <I>(x)  ^  x,  and  j^et 


Hihle  topological  pro|N-rtieN  of  the  family  of  curvea 
{y  -C},  and  the  act  P  can  vary  a  go(Ml  deal.  We  ahall 
not  go  into  thia  here,  but  confine  ouraelvua  to  a  few 

remarka. 

The  finit  of  the  two  aide  conditiona  d9)>0,  dr>0 
Hocms  natural  in  many  situationa,  but  thia  cannot  b<‘ 
aaid  about  the  other  one.  We  might  aometimea  prefer 
to  work  with  the  cxpreaaion 

«(>')  '  j*  [<i(r,<f  )d4p  t  b{r,<f  )\dr\]. 


L 

9' 


or  uae  some  other  choice  of  <I>. 

We  want  to  minimize  the  total  effect 


when  y  variea  over  the  aet  P.  Thia  problem  btdonga 
to  the  calculus  of  variation,  but  it  ia  of  very  simple 
form,  and  it  will  be  convenient  to  discuss  it  directly. 
We  need  not  use  the  special  form  of  the  differential; 
it  has  been  introduced  to  8<Tve  as  an  illustration.  In¬ 
stead,  we  will  try  to  minimize  e(y)  in  somewhat  greater 
generality.  Suppose  that,  for  any  y€P,  we  have  dr>  0, 
d(p>0,  and  that  the  contour  curves  y=  const,  divide 
the  plane  as  indicated  in  Fig.  22,  so  that  y  is  a  non¬ 
decreasing  function  of  a  on  every  y. 


It  is  difficult  to  see  how  the  previous  reasoning  could 
be  applied  directly. 

We  hav(‘  not  discussc'd  the  Hmoothm^as  conditions 
that  should  be  imiH^wd  on  the  trajectories.  Few  reg¬ 
ularity  difficulties  will  arisi;  if  <p  and  r  are  assumed  to 
be  of  bounded  variation.  N«*ither  is  there  any  great 
difficulty  in  verifying  that  the  maximum  is  attained. 
To  see  this,  the  interested  reader  is  advised  to  study 
some  special  case. 

If  but  dr.  can  take  both  signs,  we  can  only 

give  some  vague  hints  about  how  the  method  could  be 
made  to  work.  Consider  a  trajectory  y  joining  po  and  p^. 
Suppose  that  y  consists  of  a  number  of  arcs  y,,  v  = 
1,2,  ...,n,  such  that  dr  has  constant  sign  on  each  of 
these  arcs.  If  the  end  points  of  yy  are  denoted  pj  and 
p],  the  following  holds.  In  order  that  y  should  be 
optimal,  each  yy  must  have  the  similar  optimality  prop¬ 
erty.  For  given  values  of  pi,  p\,  we  can  then  deter¬ 
mine  the  conditional  optimal  form  of  yy.  We  must  then 
let  po,  p\  vary  to  find  the  global  maximum.  If  the 
optimal  y  is  of  this  form,  the  problem  has  been  reduced 
to  a  finite  minimum  problem.  Especially  if  n  is  small, 
n  =  2  or  n  =  3,  we  have  some  hope  of  finding  the  opti¬ 
mum  explicitly.  Otherwise,  the  computational  diffi¬ 
culties  will  probably  prevent  a  successful  solution  along 
these  lines. 

Let  us  now  approach  this  problem  from  the  point 
of  view  of  the  classical  calculus  of  variation.  The  total 
effect  was  additively  built  up  from  infinitesimal  con¬ 
tributions  that  could  be  written  as 

p(r)y(B) 


Fig.  22.  Surface*  of  constant  V-  mentioned  one  special  case  where 


Consider  the  segment  of  y  in  the  strip  between  the 
contour  lines  y  ^  C  and  y  ■=  C  +  c.  E  must  pass  through 
the  strip,  and  it  is  to  his  advantage  to  do  this  where 
is  as  large  as  possible.  This  will  help  us  in  choosing 
the  optimal  trajectory.  In  special  cases,  the  idea  of 
this  heuristic  reasoning  is  not  too  difficult  to  complete. 
A  general  treatment  is  complicated  by  the  many  pos- 


q(d)  =-■  X  |din  B\  +  |cos  y|. 

In  general,  y(d)  will  depend  upon  the  geometric  confi¬ 
guration  of  the  target.  This  dependence  can  be  very 
complicated,  and  we  catmot  assume  directly  any  general 
formula  for  y(0)  if  we  seek  a  rt'alistic  mod<*l.  Let  us 
write,  however. 
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p(y)-  f  p{r)y(0)^=^  f  L{q  ,  r,  r')d(f', 

J  Y  J  Y 

where  L  is  a  function  of  tp,  r  riq),  and  r'  r((p).  If 
L  is  sufficiently  smooth,  we  have  an  ordinary  varia¬ 
tional  problem  of  standard  type.  The  tnuitmt  at  is 
straightforward:  we  vary  the  function  r(q') 

rA(p)^r((p)  ' 
f{9''u)  =  f(9’i)  0,  ] 

and  get  for  the  new  trajectory  yt,  corresponding  to 

rvi  /*vi  r 

«(yi’)=  L(f,rt,r',)d(p--  \L((p,r,r') 

J  f  •  J  9  •  L 


the  velocity  c  in  a  direction  given  in  t(>rins  of  the 
angh's  a  and  0.  A  differential  equation  n-lates  r,  a,  and 
0  to  each  other,  and  expresses  that  the  velocity  v  is 
directed  along  the  tangent  of  p's  trajectory.  If  p  is 
cxpo.sed  to  some  additive  activity  during  its  motion, 
we  will  try  to  find  the  trajectory  that  minimizes 

\  K[r,ix(r),(x(r)]dr. 

Jo 

We  have  assumed  that  the  motion  is  such,  that  r  de¬ 
creases  monotonically  from  the  initial  value  Tq  to  0. 
Clearly,  this  is  a  variational  problem  of  the  same  t^'pe 
as  before. 

Let  us  now'  return  to  the  ecjuat'on 


+  £if)  L((p,  r,  r')  -(  e' (rp)  /  ,  L((p,  r.  r') 
cr  dr 


d(p 


+  higher  order  terms. 


After  a  partial  integration,  we  get,  taking  into  account 
the  side  conditions  f(<Po)  d. 


dL^  8^L 

dr  cr'  d(f 

and  see  what  happens  in  a  special  case.  Assume  that 
the  infliK'nco  of  the  distance  is  negligible,  p(r)  =  C,  and 
'hat  the  dependence  upon  the  direction  has  the  form 


e(y,)-e(y)== 


\dL 

d^L  ■ 

< 

. 

1 

dr'  dcp 

e((jp)  d<p  h  ...  . 


In  order  that  this  variation  shall  vanish  for  every’  e((f>).  This  can  be  said  to  correspond  to  the  target  having 
we  get  the  classical  equation  elliptical  configuration.  We  then  have 


dL^  d^L 

dr  dr'  d<p 


It  is  known  that  this  heuristic  argument  does  not  al¬ 
ways  lead  to  a  minimum.  Lc*t  us  note  tlu'  following, 
however. 

This  approach  is  flexible,  since  we  can  choose  y(0) 
freely  and  make  it  fit  the  concrete  problem.  But  it 
does  not  include  the  previous  method  as  a  special  case, 
since  in  this  the  function  y{0)  was  not  differentiable. 
Without  introducing  any  essential  changes,  we  can  use 
the  same  approach  for  the  case  where  tlu'  point  q  moves, 
see  Fig.  21.  It  is  clear  that  this  mcxlification  is  of 
practical  intere.st.  Let  us  di.scuss  the  following  situa¬ 
tion.  The  point  q  moves  along  the  straight  line  L, 
Fig.  23.  The  point  p  tries  to  reach  q  and  moves  with 


Fig.  23.  Modifying  tho  previous  problem  to  the  case  where  q  is 
moving. 


"  ^  I*  f  «(r')*  dcp. 


This  is  very  simple,  since  L  does  not  contain  <p,  so  that 


d 
dcp  L 


,  dL 

L-r 

dr 


dL  ,  dL  dL  ,  d^  L 

- ^  —  — 

dr  dr  dr'  dr'  dcp 


8L_  d^L 
[  dr  dr'  dcp 


0. 


which  gives  us 


L~  r'^^,  ==  constant  k. 
dr 


Solving  this,  we  get 

l/6r»  +  a(r')»-  .  -  =  ifc, 

/6rM-a(r')* 

and  br^  kVhr^  +  air'f. 

Hence,  r'  is  given  by 

,  ^]/b^r*-k^r^ 
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M(»  tllilt 


dr. 

The  cotiHtant  k  Hhall  bo  dotorminocl  bo  that  tho  tra¬ 
jectory  paHMOH  through  tho  point  p,,  (p(ri)  (f^. 

Note  that  if  wo  want  to  include  tho  distance  func¬ 
tion  p(r),  very  little  need  be  changed  in  the  above. 

\V(^  meet  a  more  difficult  problem  when  we  try  to 
combine  the  direitional  dependence  that  we  have  dis- 
cusHod  with  stochastic  eh'ments  in  the  evasive  maneu¬ 
vers  and  in  the  ballistic  properties  of  the  weapons. 
The  prediction  introduces  an  error  d,  just  as  before. 
But  now  we  al.so  have  the  ballistic  dispersion  rj  around 
the  point  of  aim,  E*.  It  is  natural  to  consider  <5  and 
T]  as  stochastic  vectors.  The  target,  whose  arc  will  be 
denoted  by  A,  will  be  rotated  through  some  angle  rp 
during  the  time  h.  The  evasive  maneuvers  an*  carried 
out  not  only  to  increase  d,  but  to  influence  the  angle 
y ,  .so  that  the  target  will  be  more  difficult  to  hit.  In 
geiK  ral,  the.se  two  quantities  are  not  inde|)endent  of 
each  other.  For  very  narrow  (needle  formed)  targets 
the  change  in  q->  can  be  more  important  than  6. 

To  tak(‘  these  factors  into  account,  we  must  make 
mon;  precise  assumptions  on  the  probabilistic  properties 
of  the  relevant  quantities.  Earlier  we  worked  mainly 
with  criteria  such  as  miss  distance,  and  we  could  use 
linear  methods  based  on  the  first  and  second  order 
moments  of  these  probability  distributions.  This  is  no 
longer  so.  To  study  the  directional  effect  of  the  geo¬ 
metric  form  of  the  target,  we  must  integrate  over  the 
area  A  oriented  with  a  certain  angle  f,  see  Fig.  24. 
To  be  able  to  do  this,  we  must  know  the  frequency 
function  appearing  as  the  integrand. 


To  make  this  more  concrete,  we  shall  a.ssume  that 
the  vectors  d  and  rj  are  normally  distributed.  This  is 
a  standard  assumption  in  such  problems,  but  that  does 
not  mean  that  it  is  a  good  approximation.  Further, 
we  must  know  the  distribution  of  <p,  which  leads  us 
to  an  intere.sting  question.  We  can  express  the  distribu¬ 
tion  of  9?  in  terms  of  the  functions  g(t}  and  y(z),  if  the 
evasive  tactics  is  given  by 

x(t)  -  x(0)  4  V  cos  (f,  ds, 

J  0 

y{t)  =  y(0)  -f  V  f  sin  93,  ds, 

Jo 


as  in  an  earlier  section.  In  the  important  case  where 
y(z)  is  a  s('Cond  order  polynomial,  the  angh*  (p  is  nor¬ 
mally  distributed.  Another  type  of  evasion  is  as  follows: 
y(t}  is  a  normal  process  with  mean  square  e*  =  £'[«/(<)]*, 
and  x(t)  is  determined  so  that  the  velocity  is  approxi¬ 
mately  constant,  [x(<)j*  )  !»/(<)]*  This  is  possible  only 
if  is  small,  e'v<\.  This  model  is  suitable  for  describing 
small,  non-systematic  evasive  maneuvers  from  a  fixed 
trajectory,  here  thought  of  as  a  straight  line.  Since 


cos  9),  ^ 


y{t)  _  y(i) 


it  is  clear  that  cos  9,  is  also  approximately  normal. 
Many  variants  of  this  model  are  possible. 

Another  circumstance  should  b(>  observed.  Let  the 
angle  (p  have  a  frequency  function  p[(p).  In  general, 
we  are  only  interested  in  tlu*  value  of  y  modulo  2;t. 
Let  us  denote  the  angle  (p>  reduced  to  the  interval 
(-71,  7i)  by  a.  Then,  a  has  a  frequency  function  9(a) 
that  can  be  conqiuted  directly  a.s 

00 

?(*)  Pi<^  -7i<a<7i. 

k  ■'  00 

In  the  case  where  93  has  almost  all  its  probability  mass 
in  a  small  interval,  we  need  only  use  one  term  in  the 
above  sum.  If  the  evasion  uses  more  violent  turns,  we 
may  have  to  use  several  of  the  terms.  In  the  special 
case  of  a  normal  distribution  we  would  get 


1  ~ 

,,  Z  e*P 

aY2  7i  k-  00 


(a  -  '2k7i)* 


which  can  be  identified  as  a  t?-function. 

The  analytic  treatment  of  stochastic  maneuvers  can 
be  a  good  deal  more  complicated  when  we  have  direc¬ 
tional  dependence.  Let  us  discuss  briefly  the  case  of 
normal  distributions.  With  the  previously  introduced 
notation,  we  have 


FritjeT.A  t  d}. 

Here,  A  is  the  target  area  with  the  orientation  it  had 
at  t  =  0.  The  set  denotes  the  congruent  region 

after  a  rotation  by  the  angle  93.  The  set  de¬ 

notes  the  set  TyA  translated  by  the  vector  d,  the  error 
of  prediction.  The  vector  r]  means  the  ballistic  error.  Let 
us  first  calculate  the  conditional  probability  for  a  fixed 
value  of  d 

Pr  Fr{j;€T^A  (  (5|(5}-E  JJ  f(ri)dr], 
where  j{ri)  is  assumed  to  be  a  tiormal  frequency  function 
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^  ,,  ,  ‘‘xp  (  -  i 

'2n  1  (lot  M 


The  symbol  E  Htands  hero  for  mathomatical  expecta¬ 
tion,  int{'gration  over  the  ^alll(^s  of  qr.  After  Hiibstituting 
T^rj  *  fi-y,  we  ^et  the  relation 


I'r  jjr-ni’,' 

l‘r--  (  \k,[!/)dy, 


(y-^)\dy 


where 


hs(y)=  -  Eexp[  -  J(y- Af  ‘T'(y-^)]. 

2  ,T  1  (let  if 

We  can  write  the  orthogonal  matrix  as 


cos  (p  sin  (f 
sin  y  cos  <p 


so  that  hg  (u)  =  ,  E  exp  -  J  Q, 

2  71  K  det  if 

where  ^  is  a  bilinear  form  in  cos  and  sin  q.  Denote 
the  normed  eigenvectors  of  the  symmetric  matrix  if'* 
by  f,,  f,  with  the  corresponding  eigenvalues  m,,  nij. 
We  get 

^’v'(y<J)  =  l!y“^ll  {fi  cos  (9?+  a)  +  fj8in  (q  ha)} 


e  =  (y-<5)'  T^M-'T’^(y-d) 

=  II  y  -  <5 II*  {m,  cos*  (99  4  a)  4-  mj  sin*  (9)  4  a)} 

=  lly-  ^”2)  cos*  (99  4-  (x)  +  m^}. 

Since  det  if  ==  Wj  *  *,  and  if  y  =  cos  (99  4-  a)  has  the 

frequency  function 

p<“i~ 

al  2;r 

we  have 


r*  ti^  1 

exp  -  ||y-(5||*(m, -mj)4--2 

J  OC  I  “  L 


+  I|y-  <5||*  I  du 
*«."**  exp-l'^“'^l'\«  . 

2,'ia  1  ||y- (J,l*  (wii  -  t  1  a*  -  * 

This  is  a  conditional  frequency  function  (for  given  value 
of  A),  and  it  should  be  observed  that  the  jiaranieters 
in  this  expression  depend  in  general  upon  (5.  To  ob¬ 


tain  the  (absolute)  fre(juen('y  function — n(*(‘(led  to  cal¬ 
culate  the  (b'sired  probability  of  hit — we  must  perform 
OIK!  more  inti'gration.  To  bi*  able  to  carry  out  this, 
we  must  know  the  distribution  of  <5  and  its  influence 
upon  (f.  This  will  depend  upon  the  construction  of  the 
prediction  system,  and  an  analytic  treatment  of  this 
(luestion  would  require  a  complete  specification  of  the 
predictor.  We  shall  not  attempt  to  do  this  here,  but 
it  should  be  ('inphasized  that  the  present  discussion 
should  be  seen  only  as  an  illustration  of  how  the  prob- 
hun  can  be  approached. 


Fi^.  2ij.  Optimal  trajoctory  over  a  dofendecl  area. 

Consider  the  following  pursuit  problem.  The  area  A 
should  be  defended  against  an  invader  (airplane,  mis¬ 
sile)  E  (Fig.  25).  We  a-ssume  that  p  identical  defen.sive 
weapons  (AA  guns,  ground-to-air  missiles)  have  been 

located  in  the  points  . Ap.  While  E  closes  in 

on  the  target,  he  is  exposed  to  fire  from  the  defensive 
weapon  system,  and  the  effect  of  this  is  assumed  to 
be  continuous  and  additive.  We  get  the  total  effect 
corresponduig  to  a  trajectory  P 

uiF)---  f  ^  w;(||A^-i;||)(/f=  ^  ^  f  w{\\Ay-E\\)ds, 
Jr  r-i  ►-!  Jr 

where  v  is  the  constant  speed,  and  the  function 
ie(||  A„- .£^11 )  characterizes  the  weapon,  whose  effect 
should  depend  only  upon  the  distance  ||A„  -iJlI.  The 
function  w  is  presumably  a  decreasing  function,  po.ssibly 
with  an  exception  for  very  shjrt  distances.  For  large 
arguments,  w  vanishes.  If  one  wishes  one  can  modify 
the  model  in  such  a  way  that  w  also  depends  upon  the 
direction  of  the  vector  A^~E. 

The  trajectory  F  starts  in  a  given  point  Ef^,  that  can 
be  chosen  as  the  point  of  infinity.  The  end  of  the  tra¬ 
jectory  is  free  but  should  be  insiue  A.  Note  that  A 
is  really  the  area  inside  which  E  should  use  his  own 
weapon  in  order  to  achieve  the  result  he  desires.  The 
real  target  may  very  well  be  somewhere  else,  inside  or 
outside  A.  Among  all  the  admissible  trajectories,  we 
should  choo.se  the  one  that  minimizes  the  value  of  the 
optimality  criteria  lefF). 
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This  problem  is  very  similar  to  what  we  have  dis- 
eiissed  before.  It  may  bo  interesting  to  note,  however, 
that  this  is  a  elassieal  extremal  problem  from  geomet¬ 
rical  optics.  Introduce  tlx;  function 


max  min  I  M(x,  y)  dF(x)  dG{y) 

!•'  J  n  J  0 

^  min  max  f  f  M{T,y)dF(x)  dO{y). 

J  Q  J  0 


n'{E) 


1 


and  choose  the  curve  that  minimizes  the  integral 


min. 


Here,  F  and  (1  are  distribution  functions  over  the  unit 
interval.  It  should  bo  noted  that  the  analogous  state¬ 
ment  holds  for  a  continuous  game  played  over  a  compact 
region  in  Euclidean  space  E". 

It  is  often  convenient  to  solve  the  game  as  follows. 
.Supf)ose  that  wt!  can  find  a  constant  v  and  two  dis¬ 
tribution  functions  /’q  ^'o-  •‘^'ich  that 


But  if  we  consider  a  medium  where  the  speed  of  light 
is  given  by  the  function  u'(E),  tlu'  above  relation  is 
identical  with  the  well-known  princii>le  of  hVrmat  that 
the  light  rays  follow  {(aths  that  minimize  the  time  it 
takes  to  travel  along  them.  If  we  know  the  light  veloc¬ 
ity  w'(A’),  we  can  determine,  at  least  approximately, 
these  trajectories  numerically,  using  the  law  of  refrac¬ 
tion.  In  this  way  we  get  a  simple  algorithm  to  solv(‘ 
the.se  special  j)ursuit  probiems. 

The  valu(‘  of  min  tefF)  depends  u{)on  how  the  defen¬ 
sive  weapons  have  been  placed,  i.e.,  upon  A,^,  ... ,  A^. 
From  the  poitit  of  view  of  the  defender,  it  is  natural 
to  choose  such  an  arrangernei’t  of  .d  ,j.  .-12,,  . . .  ,/lp  that 
this  value  is  made  as  large  as  possible.  We  try  to  find 

max  min  i/'lF). 

/t,  r 

We  shall  not  attempt  a  solution  of  this  interesting 
problem. 

The  reader  whose  patience  has  enabled  him  to  follow 
the  long  and  sometimes  laborious  discu.ssion  in  this  paper 
will  be  aware  of  the  fact,  that  there  exists,  so  far,  no 
coh  -rent  and  general  theory  for  solving  pursuit  prob¬ 
lems.  It  is  hoped,  however,  that  he  has  got  an  idea 
of  the  philosophy  of  evasive  maneuvers  expressed  in 
quantitative  terms. 


NOTES 

In  the  text  we  have  used  mathematical  tools  all  of 
which  may  not  be  familiar  to  the  reader.  Therefore  we 
shall  describe  some  of  them  briefly  here  and  give  ref¬ 
erences  where  the  reader  can  find  more  information  on 
these  subjects. 

As  far  as  game  theory  is  concerned,  we  have  used 
only  elementary  facts.  We  use  many  times  t/ie  funda¬ 
mental  theorem  for  continuous  games  on  the  unit  square; 
If  the  payoff  function  M(x,y)  is  continuous  in  0=61  x, 
y  1 ,  one  has 


f  3/{x,  y)(/6'o(y)  ^ 

J  (» 

f  M(x,y)dFo{x)  ^  V. 

J  0 

Then  e  is  the  value  of  the  game,  and  Fg  and  (Jg  are 
optimal  stritegies. 

When  the  continuous  payoff  function  is  strictly  convex 
in  y,  there  is  a  simple  optimal  strategy  for  the  iecond 
plav'T,  HO  that  (i  is  reduced  to  a  step  functi.jii,  say 
with  the  step  at  y  =c.  The  value  of  the  game  is  then 

V  min  max  M(x,  y). 

V  I 

Similarly  if  M(x,y)  is  strictly  concave  in  //• 

More  information  on  this  subject  can  be  found  in 
the  books  of  Me  Kinsey  (1952)  and  Blackwell  &  Gir- 
shick  (1954). 

More  knowledge  is  assumed  about  stationary  stochastic 
processes.  If  x,  is  a  continuous  (in  the  mean)  stationary 
process  of  finite  variance  and  with  mean  zero,  its  co- 
variance  function  can  be  written  as 

r(/i)  =  Ex,.,x,=  r  e“'dE(A). 

J  oo 

This  is  Bochner’s  representation.  F(X)  is  a  bounded 
non-decreasing  function.  With  this  is  a.ssociaU'd  C'ra- 
m^r’s  repre.sentation 

X,-  f”  c''^dZ(A), 

J  OO 

where  Z(A)  is  a  proce.ss  with  uncorrelated  increments, 
such  that 

E[Z(A')-Z(A')]*=|F(A')--P’(A')|. 

A  proce.ss  is  called  purely  7ion -deterministic  if  the 
manifolds  L.^(x;t)  spanned  by  x  for  all  s-'  t  have  the 
property  that 

lim  L.^(x\t)  9. 

OC 
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Such  a  process  can  bo  written  as  an  infinite  moving 
average 

x,=  f  (j(t  s)d^(ii), 

J  OO 

where  (j(t)  is  quatlratically  integrahle  with  respect  to 
Li'besguo  measure,  and  |(,s)  is  a  stochastic  process  with 
uncorrelated  increments,  with 

The  representation  is  not  unique.  It  is  most  convenient 
to  choose  the  predictive  form,  where  L.^(x\t)  =  L2(^\t), 
all  t,  with  a  notation  similar  to  the  one  introduced 
above.  Then,  the  best  linear  j)rediction  x*,  ^  of 
when  we  have  observed  x,,  s  is 
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(/(M- A-s)  d^(s). 


The  minimum  prediction  error  is 


<A 


This  is  discussed  in  detail  by  Doob  (1953,  Chapter  XI). 

VVe  use  repeatedly  known  facts  about  (weak)  con¬ 
vergence  of  distribution  functions,  compactness  of  sets  of 
distributions,  etc.  In  this  context  the  reader  is  referred 
to  Gnedenko  &  Kolmogorov  (1954,  Chapter  2). 

In  one  proof  we  use  a  theorem  about  Toeplitz  forms. 
It  can  be  found  in  Grcnander  &  Szego  (1958,  Chapter  9). 

In  connection  with  linear  stochastic  differential  equa¬ 
tions,  we  run  into  the  old  problem  of  how  they  should 
be  interpreted  when  the  derivatives  do  not  exi.st.  A 
simple  way  is  to  demand  that  the  corresponding  rela¬ 
tion  holds  after  multiplying  the  equation  with  an  ar¬ 
bitrary  continuous  function  and  integrating  formally. 

The  infinitely  divisible  distributions  that  appear  in  the 
text  are  also  discu.s.sed  by  Gnedenko  &  Kolmogorov  (op. 
cit.),  where  also  the  representation  of  Levy-Khinchin 
can  be  found.  This  may  be  of  use  in  a  more  thorough 
treatment  of  certain  pursuit  problems. 

In  4.4  we  use  the  notion  of  a  renerml  process.  This 
is  a  point  proce.ss,  sueh  that  the  distances  between 
successive  points  are  independent  and  identically  dis¬ 
tributed  stochastic  variables.  This  distrilmtion  is  related 
to  the  distriliution  from  a  fixed  point  to  tlu*  next  fol¬ 
lowing  (event),  .see  I’arzen  (1902,  (3iapter  5). 
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